Apr 12 09:02:27 user devstack@n-api.service[61852]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 09:02:27 user devstack@n-api.service[61852]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 09:02:27 2023] *** Apr 12 09:02:27 user devstack@n-api.service[61852]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 09:02:27 user devstack@n-api.service[61852]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 09:02:27 user devstack@n-api.service[61852]: nodename: user Apr 12 09:02:27 user devstack@n-api.service[61852]: machine: x86_64 Apr 12 09:02:27 user devstack@n-api.service[61852]: clock source: unix Apr 12 09:02:27 user devstack@n-api.service[61852]: pcre jit disabled Apr 12 09:02:27 user devstack@n-api.service[61852]: detected number of CPU cores: 12 Apr 12 09:02:27 user devstack@n-api.service[61852]: current working directory: / Apr 12 09:02:27 user devstack@n-api.service[61852]: detected binary path: /usr/bin/uwsgi-core Apr 12 09:02:27 user devstack@n-api.service[61852]: your processes number limit is 63637 Apr 12 09:02:27 user devstack@n-api.service[61852]: your memory page size is 4096 bytes Apr 12 09:02:27 user devstack@n-api.service[61852]: detected max file descriptor number: 2048 Apr 12 09:02:27 user devstack@n-api.service[61852]: lock engine: pthread robust mutexes Apr 12 09:02:27 user devstack@n-api.service[61852]: thunder lock: enabled Apr 12 09:02:27 user devstack@n-api.service[61852]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 09:02:27 user devstack@n-api.service[61852]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 09:02:27 user devstack@n-api.service[61852]: Python main interpreter initialized at 0x55fb89d2c990 Apr 12 09:02:27 user devstack@n-api.service[61852]: python threads support enabled Apr 12 09:02:27 user devstack@n-api.service[61852]: your server socket listen backlog is limited to 100 connections Apr 12 09:02:27 user devstack@n-api.service[61852]: your mercy for graceful operations on workers is 90 seconds Apr 12 09:02:27 user devstack@n-api.service[61852]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 09:02:27 user devstack@n-api.service[61852]: *** Operational MODE: preforking *** Apr 12 09:02:27 user devstack@n-api.service[61852]: *** uWSGI is running in multiple interpreter mode *** Apr 12 09:02:27 user devstack@n-api.service[61852]: spawned uWSGI master process (pid: 61852) Apr 12 09:02:27 user devstack@n-api.service[61852]: spawned uWSGI worker 1 (pid: 61853, cores: 1) Apr 12 09:02:27 user devstack@n-api.service[61852]: spawned uWSGI worker 2 (pid: 61854, cores: 1) Apr 12 09:02:27 user devstack@n-api.service[61852]: spawned uWSGI worker 3 (pid: 61855, cores: 1) Apr 12 09:02:27 user devstack@n-api.service[61852]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 09:02:27 user devstack@n-api.service[61853]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 09:02:27 user devstack@n-api.service[61855]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 09:02:27 user devstack@n-api.service[61854]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 09:02:31 user devstack@n-api.service[61853]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 09:02:31 user devstack@n-api.service[61853]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 09:02:31 user devstack@n-api.service[61853]: and ``live_migration_inbound_addr`` respectively. Apr 12 09:02:31 user devstack@n-api.service[61853]: ). Its value may be silently ignored in the future. Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 09:02:31 user devstack@n-api.service[61855]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 09:02:31 user devstack@n-api.service[61855]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 09:02:31 user devstack@n-api.service[61855]: and ``live_migration_inbound_addr`` respectively. Apr 12 09:02:31 user devstack@n-api.service[61855]: ). Its value may be silently ignored in the future. Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 09:02:31 user devstack@n-api.service[61854]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 09:02:31 user devstack@n-api.service[61854]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 09:02:31 user devstack@n-api.service[61854]: and ``live_migration_inbound_addr`` respectively. Apr 12 09:02:31 user devstack@n-api.service[61854]: ). Its value may be silently ignored in the future. Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61855) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 09:02:31 user devstack@n-api.service[61853]: INFO dbcounter [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Registered counter for database nova_api Apr 12 09:02:31 user devstack@n-api.service[61855]: INFO dbcounter [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Registered counter for database nova_api Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61854]: INFO dbcounter [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Registered counter for database nova_api Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_db.sqlalchemy.engines [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61855) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writer thread running {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG nova.context [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af22f43d-4450-44e6-b1ae-31d2ee8b98d0(cell1) {{(pid=61853) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG nova.context [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af22f43d-4450-44e6-b1ae-31d2ee8b98d0(cell1) {{(pid=61855) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:02:31 user devstack@n-api.service[61853]: INFO dbcounter [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Registered counter for database nova_cell0 Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:02:31 user devstack@n-api.service[61853]: INFO dbcounter [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Registered counter for database nova_cell1 Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG nova.context [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af22f43d-4450-44e6-b1ae-31d2ee8b98d0(cell1) {{(pid=61854) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 09:02:31 user devstack@n-api.service[61855]: INFO dbcounter [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Registered counter for database nova_cell0 Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:02:31 user devstack@n-api.service[61855]: INFO dbcounter [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Registered counter for database nova_cell1 Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:02:31 user devstack@n-api.service[61854]: INFO dbcounter [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Registered counter for database nova_cell0 Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61854]: INFO dbcounter [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Registered counter for database nova_cell1 Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_db.sqlalchemy.engines [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61855) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writer thread running {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_db.sqlalchemy.engines [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61855) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61853]: INFO dbcounter [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Registered counter for database nova_cell0 Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writer thread running {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61855]: INFO dbcounter [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Registered counter for database nova_cell0 Apr 12 09:02:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61854]: INFO dbcounter [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Registered counter for database nova_cell0 Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG oslo_db.sqlalchemy.engines [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61855) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writer thread running {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 09:02:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 09:02:32 user devstack@n-api.service[61855]: WARNING keystonemiddleware.auth_token [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 09:02:32 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 09:02:32 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 09:02:32 user devstack@n-api.service[61855]: WARNING keystonemiddleware.auth_token [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 09:02:32 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 09:02:32 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 09:02:32 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 09:02:32 user devstack@n-api.service[61855]: WARNING keystonemiddleware.auth_token [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 09:02:32 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 09:02:32 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 09:02:32 user devstack@n-api.service[61855]: WARNING keystonemiddleware.auth_token [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 09:02:32 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-56eaa26e-4667-4025-848c-7af8ce1d22e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 09:02:32 user devstack@n-api.service[61854]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fb89d2c990 pid: 61854 (default app) Apr 12 09:02:32 user devstack@n-api.service[61855]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fb89d2c990 pid: 61855 (default app) Apr 12 09:02:32 user devstack@n-api.service[61853]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fb89d2c990 pid: 61853 (default app) Apr 12 09:02:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:02:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001646 Apr 12 09:02:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 09:02:32 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2ff733dd-60a3-4e0e-8dfe-38ad97a33dfc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002033 Apr 12 09:04:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 1/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:40 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2e86e030-6937-433d-b77a-a46193b8b35f admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2e86e030-6937-433d-b77a-a46193b8b35f admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463488 Apr 12 09:04:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 09:04:40 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:42 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001574 Apr 12 09:04:42 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 2/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ca039d1e-ad51-4605-bf2a-d9b8e3400d48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "name": "cirros256"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ca039d1e-ad51-4605-bf2a-d9b8e3400d48 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.319890 Apr 12 09:04:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 2/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:42 2023] POST /compute/v2.1/flavors => generated 405 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7e1aed65-04b2-4560-b247-a946040ca0ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7e1aed65-04b2-4560-b247-a946040ca0ad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085241 Apr 12 09:04:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 09:04:42 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:44 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:44 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001318 Apr 12 09:04:44 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 3/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-96033a90-143c-4015-a4ed-9a2c46bfdf50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "ram": 512}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-96033a90-143c-4015-a4ed-9a2c46bfdf50 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064980 Apr 12 09:04:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 3/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-abfe5b0d-029e-4da9-b506-3e61e5bbff0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-abfe5b0d-029e-4da9-b506-3e61e5bbff0c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027666 Apr 12 09:04:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 09:04:44 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001323 Apr 12 09:04:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 4/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-fbc93ffe-dbe7-4320-a254-3d246f10e0d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "swap": 0, "id": "d2"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-fbc93ffe-dbe7-4320-a254-3d246f10e0d3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066280 Apr 12 09:04:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 4/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:46 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-108981ac-9c92-4398-8a9d-576fd9f28f9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-108981ac-9c92-4398-8a9d-576fd9f28f9c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024808 Apr 12 09:04:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 09:04:46 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001426 Apr 12 09:04:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 5/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0930a8f6-6589-4a1b-b03b-af91eecac7d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0930a8f6-6589-4a1b-b03b-af91eecac7d7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065601 Apr 12 09:04:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 5/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:48 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-45c5d41e-2c32-44a1-a2bb-a152c021ff2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-45c5d41e-2c32-44a1-a2bb-a152c021ff2d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024008 Apr 12 09:04:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 09:04:48 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001501 Apr 12 09:04:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 6/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-637ebc22-56ab-441f-99bc-e0fdf5c6f4ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-637ebc22-56ab-441f-99bc-e0fdf5c6f4ae admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.104843 Apr 12 09:04:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 6/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:50 2023] POST /compute/v2.1/flavors => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031323 Apr 12 09:04:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 09:04:50 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:52 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-936da56a-34d2-4f92-b4c2-b725c5e7f674 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002178 Apr 12 09:04:52 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 7/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e8fbc8e8-0251-4acb-a595-fde4010f5c3c admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e8fbc8e8-0251-4acb-a595-fde4010f5c3c admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.077055 Apr 12 09:04:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 7/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 09:04:52 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:04:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002502 Apr 12 09:04:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:54 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:54 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:54 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:54 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:54 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:04:54 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-43d6049f-757b-4f93-a911-41ad6d6e6e98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:54 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-43d6049f-757b-4f93-a911-41ad6d6e6e98 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.352802 Apr 12 09:04:54 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 8/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:54 2023] POST /compute/v2.1/flavors => generated 400 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5ee81bf1-37b1-4b2a-834d-2bf077de1946 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5ee81bf1-37b1-4b2a-834d-2bf077de1946 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039341 Apr 12 09:04:55 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 8/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 09:04:55 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002172 Apr 12 09:04:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:56 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-451d1ad6-cdc8-4660-bea3-064854a40e8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "swap": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:57 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-451d1ad6-cdc8-4660-bea3-064854a40e8a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060247 Apr 12 09:04:57 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 9/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:56 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a3ef1cfe-c112-41eb-97df-4347b192a3f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a3ef1cfe-c112-41eb-97df-4347b192a3f7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027097 Apr 12 09:04:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 9/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 09:04:57 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:04:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:04:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001299 Apr 12 09:04:58 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:04:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:04:58 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d4fbd776-b259-471d-8d1c-a7e88958d70e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d4fbd776-b259-471d-8d1c-a7e88958d70e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.057151 Apr 12 09:04:58 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 10/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:04:58 2023] POST /compute/v2.1/flavors => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:04:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-eea787d2-e3d4-436d-a855-2efa7ec8455e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:04:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-eea787d2-e3d4-436d-a855-2efa7ec8455e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024594 Apr 12 09:04:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 10/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 09:04:58 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:05:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:05:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002359 Apr 12 09:05:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:05:00 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:05:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-63baf209-8290-4004-96f2-836040afcf4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:05:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-63baf209-8290-4004-96f2-836040afcf4c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.071602 Apr 12 09:05:00 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 11/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:05:00 2023] POST /compute/v2.1/flavors => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:05:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-deda7427-ed89-4e09-a4e9-bcab0e28ff45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:05:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-deda7427-ed89-4e09-a4e9-bcab0e28ff45 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027178 Apr 12 09:05:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 11/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 09:05:00 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:05:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:05:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001431 Apr 12 09:05:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 09:05:02 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:05:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4eb54c23-5dd3-4016-9697-7af937d4adb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "disk": 160}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:05:02 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4eb54c23-5dd3-4016-9697-7af937d4adb3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080518 Apr 12 09:05:02 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 12/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 09:05:02 2023] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:05:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-87031367-3ce9-428a-aea2-e9856c9b5fc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:05:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-87031367-3ce9-428a-aea2-e9856c9b5fc7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025132 Apr 12 09:05:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 12/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 09:05:02 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:05:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:05:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-193f8f8f-f773-4aef-ae0f-f5c80ed4fcb3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002539 Apr 12 09:05:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 09:05:33 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:05:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:05:33 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.092846 Apr 12 09:05:33 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 13/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 09:05:33 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:06:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-87031367-3ce9-428a-aea2-e9856c9b5fc7 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:06:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-87031367-3ce9-428a-aea2-e9856c9b5fc7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001455 Apr 12 09:06:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 13/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 09:06:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:06:06 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:06:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c8a6da66-edec-4630-94e5-cae13196bc1c admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:06:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c8a6da66-edec-4630-94e5-cae13196bc1c admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.063072 Apr 12 09:06:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 09:06:06 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:06:10 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:06:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001438 Apr 12 09:06:10 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 14/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 09:06:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:06:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:06:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-70818ba6-cbf1-446e-8e01-9c0fa6575c48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.nano", "id": "42", "swap": 0, "ram": 128, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:06:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-70818ba6-cbf1-446e-8e01-9c0fa6575c48 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070193 Apr 12 09:06:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 14/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 09:06:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:06:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-36783287-eb46-47b1-96ee-3167fba89eda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:06:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-36783287-eb46-47b1-96ee-3167fba89eda admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026481 Apr 12 09:06:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 09:06:10 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:06:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:06:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-cde71651-5a3f-4898-ad9d-8d6658d1565b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001309 Apr 12 09:06:14 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 15/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 09:06:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:06:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8029ef4f-6365-4616-a8c9-050f36ede89d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.micro", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "ram": 192}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:06:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8029ef4f-6365-4616-a8c9-050f36ede89d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.064420 Apr 12 09:06:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 15/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 09:06:14 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:06:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d74d3a6b-25b2-48f6-bcc6-9d1eeaa13349 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:06:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d74d3a6b-25b2-48f6-bcc6-9d1eeaa13349 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027292 Apr 12 09:06:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 09:06:14 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:08:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-11437103-56b0-4308-b512-5f2f3b2e9f4a tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Action: 'create', calling method: .version_select at 0x7fbd5c96b2e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1972369587", "metadata": {"Type": "work"}}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-11437103-56b0-4308-b512-5f2f3b2e9f4a tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.605681 Apr 12 09:08:29 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 16/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 09:08:26 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 2607 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 09:08:29 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f78d4cde-b637-452e-ae5a-67baccb65aa1 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c957910>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f78d4cde-b637-452e-ae5a-67baccb65aa1 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 200 len: 353 microversion: 2.1 time: 0.366966 Apr 12 09:08:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:08:29 2023] GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 353 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-dd8e90bf-f33d-4e39-8515-39fe4f07485c tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c93f400>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-dd8e90bf-f33d-4e39-8515-39fe4f07485c tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 200 len: 354 microversion: 2.1 time: 0.185434 Apr 12 09:08:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:08:30 2023] GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 354 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-5fff1f4a-8c28-439e-9dc1-db02da3496a7 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c800940>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-5fff1f4a-8c28-439e-9dc1-db02da3496a7 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 200 len: 354 microversion: 2.1 time: 0.055846 Apr 12 09:08:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:08:30 2023] GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cdfb5f7f-19d6-4e7d-971c-b201f09cbfab tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c814040>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cdfb5f7f-19d6-4e7d-971c-b201f09cbfab tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 202 len: 0 microversion: 2.1 time: 0.076632 Apr 12 09:08:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:08:30 2023] DELETE /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:08:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-be851e21-5136-46ed-b3b4-bb5e61ce8032 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c803130>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-be851e21-5136-46ed-b3b4-bb5e61ce8032 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 200 len: 353 microversion: 2.1 time: 0.065065 Apr 12 09:08:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:08:30 2023] GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-452d2964-61c7-45db-80cb-0e5608dd5d27 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c801000>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-452d2964-61c7-45db-80cb-0e5608dd5d27 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 200 len: 353 microversion: 2.1 time: 0.062629 Apr 12 09:08:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 18/52] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:08:32 2023] GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-67252769-9100-49eb-980a-a8855fe411d8 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c814700>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-67252769-9100-49eb-980a-a8855fe411d8 tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 200 len: 353 microversion: 2.1 time: 0.055365 Apr 12 09:08:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:08:33 2023] GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1eb7c6e7-4978-4a6c-8c84-e01642c32bce tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Calling method '.version_select at 0x7fbd5c8037f0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-1eb7c6e7-4978-4a6c-8c84-e01642c32bce tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] HTTP exception thrown: Volume f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 could not be found. Apr 12 09:08:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1eb7c6e7-4978-4a6c-8c84-e01642c32bce tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Request method failure captured: Apr 12 09:08:34 user devstack@n-api.service[61853]: request: GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 HTTP/1.1 Apr 12 09:08:34 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:08:34 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:08:34 user devstack@n-api.service[61853]: Connection: close Apr 12 09:08:34 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:08:34 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:08:34 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:08:34 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:08:34 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUK5BgvXA6_w5qg1_LnORlvOytGk2UM03r--fnAD3EEFYaLhfVrA-M147Uz328X10Hux6Kfp3cPI5CSVPAgsV84wntTYTgR8_H_eT0Innlj_66QbOuuR_TV_D-AhhWB4IWtXnmYzZa7_vSbg-GMRRgKVToe9lkgowPB-4RebbNdWl8 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Project-Id: 68daedae07864ed2aecca12e3eb66d48 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesGetTestJSON-1344189961 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68daedae07864ed2aecca12e3eb66d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68daedae07864ed2aecca12e3eb66d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68daedae07864ed2aecca12e3eb66d48"}]}] Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesGetTestJSON-1344189961 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Tenant-Id: 68daedae07864ed2aecca12e3eb66d48 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesGetTestJSON-1344189961 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-User: tempest-VolumesGetTestJSON-1344189961-project-member Apr 12 09:08:34 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:08:34 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:08:34 user devstack@n-api.service[61853]: X-User-Id: 9b9c6e248ea343ca902b7d3472e33237 Apr 12 09:08:34 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesGetTestJSON-1344189961-project-member Apr 12 09:08:34 user devstack@n-api.service[61853]: method: Apr 12 09:08:34 user devstack@n-api.service[61853]: exception: Volume f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 could not be found. Apr 12 09:08:34 user devstack@n-api.service[61853]: action_args: {'id': 'f1f9b806-db42-4e7a-8b1f-eb57b6c8c226'} Apr 12 09:08:34 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 could not be found. (HTTP 404) (Request-ID: req-0f788824-6b85-4c7b-a8da-e87a379933cc) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 could not be found. Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 could not be found. Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 could not be found. Apr 12 09:08:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:08:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1eb7c6e7-4978-4a6c-8c84-e01642c32bce tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] Returning 404 to user: Volume f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:08:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1eb7c6e7-4978-4a6c-8c84-e01642c32bce tempest-VolumesGetTestJSON-1344189961 tempest-VolumesGetTestJSON-1344189961-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226" status: 404 len: 109 microversion: 2.1 time: 0.284612 Apr 12 09:08:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:08:34 2023] GET /compute/v2.1/os-volumes/f1f9b806-db42-4e7a-8b1f-eb57b6c8c226 => generated 109 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:08:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1499919168", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:37 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] validate_networks() for [('a0210d9b-0f71-4647-9f96-c9cbe32cc3d8', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for user cc51704e74b045ad9733a43aec982390 and project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:08:38 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:08:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.363851 Apr 12 09:08:38 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 19/55] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 09:08:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:08:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a3eb5d69-63db-470e-9096-148dd65452ac tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:38 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a3eb5d69-63db-470e-9096-148dd65452ac tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:08:38 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a3eb5d69-63db-470e-9096-148dd65452ac tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:08:38 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a3eb5d69-63db-470e-9096-148dd65452ac tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:08:38 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a3eb5d69-63db-470e-9096-148dd65452ac tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:08:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a3eb5d69-63db-470e-9096-148dd65452ac tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281" status: 200 len: 1395 microversion: 2.87 time: 0.124750 Apr 12 09:08:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:08:38 2023] GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281 => generated 1395 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:08:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c705fcb6-2151-4864-9456-14f0bd55023e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'create', calling method: .version_select at 0x7fbd5c864820>, body: {"keypair": {"name": "tempest-keypair-2058620837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:47 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-c705fcb6-2151-4864-9456-14f0bd55023e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:47 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-c705fcb6-2151-4864-9456-14f0bd55023e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for user 2a3731bf575c44d89211709cb07060b7 and project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:47 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-fccf7616-66ee-4c40-919d-b9e309da26f3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'create', calling method: .version_select at 0x7fbd5c8c7250>, body: {"keypair": {"name": "tempest-keypair-184491568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w=="}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:47 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-fccf7616-66ee-4c40-919d-b9e309da26f3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'key_pairs'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:47 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-fccf7616-66ee-4c40-919d-b9e309da26f3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for user 375db5b9a80244d3878822049230ba47 and project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'key_pairs'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c705fcb6-2151-4864-9456-14f0bd55023e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.427850 Apr 12 09:08:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:08:47 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-fccf7616-66ee-4c40-919d-b9e309da26f3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130418 Apr 12 09:08:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 20/58] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:08:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a569c652-6b15-4244-b011-1d09fbdd4281", "tag": "b2a3049a-cc8d-4804-854e-2451b7f886fd"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Creating event network-changed:b2a3049a-cc8d-4804-854e-2451b7f886fd for instance a569c652-6b15-4244-b011-1d09fbdd4281 on user Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61854) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Acquired lock "compute-rpcapi-router" {{(pid=61854) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:50 user devstack@n-api.service[61854]: INFO nova.compute.rpcapi [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 09:08:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61854) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 09:08:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f974692a-139d-431e-8029-cda536be1bc8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155203 Apr 12 09:08:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 20/59] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:08:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1026602398", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "c2c7e602-9c91-45a0-9625-07d734f10331"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:52 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] validate_networks() for [('c2c7e602-9c91-45a0-9625-07d734f10331', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:54 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:54 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Getting quotas for project 2c93767066d345a081bd30ca6d52ccd3. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:54 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-260276984", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ba002f9e-601a-4b3a-b386-afb97d19b8c4"}], "security_groups": [{"name": "tempest-securitygroup--1613833759"}], "key_name": "tempest-keypair-184491568", "user_data": "}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Getting quotas for user 69a651c616da4b3b98a71a43b07512d9 and project 2c93767066d345a081bd30ca6d52ccd3. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:08:54 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:08:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.029722 Apr 12 09:08:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:08:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:08:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c795864b-d97d-457a-b722-35e7cda01bee tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:54 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c795864b-d97d-457a-b722-35e7cda01bee tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:08:54 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c795864b-d97d-457a-b722-35e7cda01bee tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a651c616da4b3b98a71a43b07512d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93767066d345a081bd30ca6d52ccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:08:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c795864b-d97d-457a-b722-35e7cda01bee tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" status: 200 len: 1209 microversion: 2.1 time: 0.279079 Apr 12 09:08:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 21/61] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:08:54 2023] GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => generated 1209 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:08:54 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] validate_networks() for [('ba002f9e-601a-4b3a-b386-afb97d19b8c4', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:08:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1294510131", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:55 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] validate_networks() for [('699e7817-78bb-4ca0-bc59-8dd53b630c9b', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for user 375db5b9a80244d3878822049230ba47 and project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:08:56 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.012210 Apr 12 09:08:56 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:08:54 2023] POST /compute/v2.1/servers => generated 407 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:08:56 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-12e61497-d3bc-495e-94d0-3301b1f3d89b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-12e61497-d3bc-495e-94d0-3301b1f3d89b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:08:56 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-12e61497-d3bc-495e-94d0-3301b1f3d89b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:08:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-12e61497-d3bc-495e-94d0-3301b1f3d89b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1231 microversion: 2.1 time: 0.187690 Apr 12 09:08:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 22/63] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:08:56 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1231 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:08:56 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-9128142", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "61984664-d574-4fe6-bed1-a2eb1a52b843"}], "security_groups": [{"name": "tempest-securitygroup--1871161328"}], "key_name": "tempest-keypair-2058620837", "user_data": "}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for user 7f6b983634234693ba04a3097c2a129b and project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:08:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:08:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.968079 Apr 12 09:08:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:08:54 2023] POST /compute/v2.1/servers => generated 381 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:08:56 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-59a1cd00-0daf-47cf-b688-f0148fb7b543 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-59a1cd00-0daf-47cf-b688-f0148fb7b543 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:08:57 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] validate_networks() for [('61984664-d574-4fe6-bed1-a2eb1a52b843', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:08:57 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-59a1cd00-0daf-47cf-b688-f0148fb7b543 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:08:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-59a1cd00-0daf-47cf-b688-f0148fb7b543 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 200 len: 1216 microversion: 2.1 time: 0.390814 Apr 12 09:08:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:08:56 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 1216 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185", "tag": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1967968381", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Creating event network-changed:04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 on user Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61853) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61853) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 09:08:57 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] validate_networks() for [('699e7817-78bb-4ca0-bc59-8dd53b630c9b', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:57 user devstack@n-api.service[61853]: INFO nova.compute.rpcapi [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 09:08:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] Releasing lock "compute-rpcapi-router" {{(pid=61853) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 09:08:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-227d9d1d-2113-4435-a1bb-76cecac7492a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258993 Apr 12 09:08:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.054s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for user 2a3731bf575c44d89211709cb07060b7 and project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:08:58 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:08:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.402065 Apr 12 09:08:58 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 22/67] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:08:56 2023] POST /compute/v2.1/servers => generated 400 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:08:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-edcccad4-3978-4aab-a45c-4b3d7e42e7e8 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:08:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-edcccad4-3978-4aab-a45c-4b3d7e42e7e8 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a569c652-6b15-4244-b011-1d09fbdd4281", "name": "network-vif-plugged", "status": "completed", "tag": "b2a3049a-cc8d-4804-854e-2451b7f886fd"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Creating event network-vif-plugged:b2a3049a-cc8d-4804-854e-2451b7f886fd for instance a569c652-6b15-4244-b011-1d09fbdd4281 on user Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61855) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61855) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:59 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-edcccad4-3978-4aab-a45c-4b3d7e42e7e8 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:08:59 user devstack@n-api.service[61855]: INFO nova.compute.rpcapi [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 09:08:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] Releasing lock "compute-rpcapi-router" {{(pid=61855) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 09:08:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-edcccad4-3978-4aab-a45c-4b3d7e42e7e8 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1229 microversion: 2.1 time: 0.471571 Apr 12 09:08:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:08:58 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1229 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:08:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f3b41c25-affd-4a90-939c-ab654f5acd57 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338049 Apr 12 09:08:59 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for user 7f6b983634234693ba04a3097c2a129b and project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:08:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:09:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.664852 Apr 12 09:09:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 24/70] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:08:57 2023] POST /compute/v2.1/servers => generated 381 bytes in 2673 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:09:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e9957381-a200-4e83-a765-e07883257c80 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:00 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e9957381-a200-4e83-a765-e07883257c80 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:00 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-e9957381-a200-4e83-a765-e07883257c80 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e9957381-a200-4e83-a765-e07883257c80 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8" status: 200 len: 1216 microversion: 2.1 time: 0.233243 Apr 12 09:09:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 24/71] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:00 2023] GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 => generated 1216 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a569c652-6b15-4244-b011-1d09fbdd4281", "name": "network-vif-plugged", "status": "completed", "tag": "b2a3049a-cc8d-4804-854e-2451b7f886fd"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Creating event network-vif-plugged:b2a3049a-cc8d-4804-854e-2451b7f886fd for instance a569c652-6b15-4244-b011-1d09fbdd4281 on user Apr 12 09:09:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063549 Apr 12 09:09:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185", "name": "network-vif-plugged", "status": "completed", "tag": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700"}, {"server_uuid": "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185", "name": "network-vif-plugged", "status": "completed", "tag": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Creating event network-vif-plugged:04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 on user Apr 12 09:09:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Creating event network-vif-plugged:04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 on user Apr 12 09:09:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067135 Apr 12 09:09:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Creating event network-changed:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:09:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043750 Apr 12 09:09:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Creating event network-changed:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:09:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088724 Apr 12 09:09:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2083ddd5-0469-4385-8a32-e1be523edede tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Action: 'create', calling method: .version_select at 0x7fbd5c8e4d30>, body: {"keypair": {"name": "tempest-keypair-1337351931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm8EQfriZimJKZoTG24j09PT/XZoMDm7SAU3ypiuEbNdxZ7SDdwTjNlIAeyrJyWOC6PfocSe31LVOsrXRfE2T4ylMmBcmnO+zWFD54VyS6dBRK8fJqLCAXg2n2r8fndkQ=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:07 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2083ddd5-0469-4385-8a32-e1be523edede tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Getting quotas for project 70f74eae85c24a72a048bdd03e4d4f19. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:07 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2083ddd5-0469-4385-8a32-e1be523edede tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Getting quotas for user df9257c2223d417298b5927f7b99ac07 and project 70f74eae85c24a72a048bdd03e4d4f19. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2083ddd5-0469-4385-8a32-e1be523edede tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133253 Apr 12 09:09:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 26/76] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:09:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:08 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Creating event network-changed:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:09:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043918 Apr 12 09:09:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:10 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=22 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:10 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:10 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:10 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Creating event network-changed:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:09:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083504 Apr 12 09:09:10 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0a179232-b2d2-4084-a17d-b70dcf59d9f4 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Action: 'create', calling method: .version_select at 0x7fbd5bf6d990>, body: {"keypair": {"name": "tempest-keypair-521589223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuIgyZwMNd/jS/ptwUJ9c7NTZM1n41EYebpoe+m79K324B9wtg2doS6hIGg4lStBCzYi9hRmMjrSFhFxaPWDaPglTQ7D/AzXNQhJudprzbZalCEvYmeCtPngO6pepEMaQ=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:11 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-0a179232-b2d2-4084-a17d-b70dcf59d9f4 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting quotas for project dd9e7d6ece244a96b01277451a3ed5a5. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:11 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-0a179232-b2d2-4084-a17d-b70dcf59d9f4 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting quotas for user 8911ec7c959541989cce3870ba11fb80 and project dd9e7d6ece244a96b01277451a3ed5a5. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0a179232-b2d2-4084-a17d-b70dcf59d9f4 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.623605 Apr 12 09:09:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:09:10 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=20 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:09:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052642 Apr 12 09:09:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 27/80] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:09:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:09:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088890 Apr 12 09:09:14 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-2129617709", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3"}], "security_groups": [{"name": "tempest-securitygroup--56673280"}], "key_name": "tempest-keypair-1337351931", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:14 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] validate_networks() for [('ece9cc91-9a3c-48d7-bce4-760fc01a51f3', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Getting quotas for project 70f74eae85c24a72a048bdd03e4d4f19. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Getting quotas for user df9257c2223d417298b5927f7b99ac07 and project 70f74eae85c24a72a048bdd03e4d4f19. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:09:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:09:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.593993 Apr 12 09:09:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 28/82] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:09:14 2023] POST /compute/v2.1/servers => generated 402 bytes in 2596 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:09:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5902c334-e4a0-42e9-839e-442a714f09e7 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:16 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5902c334-e4a0-42e9-839e-442a714f09e7 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:17 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5902c334-e4a0-42e9-839e-442a714f09e7 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9257c2223d417298b5927f7b99ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f74eae85c24a72a048bdd03e4d4f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5902c334-e4a0-42e9-839e-442a714f09e7 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3" status: 200 len: 1226 microversion: 2.1 time: 0.157405 Apr 12 09:09:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:16 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3 => generated 1226 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:17 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:09:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402985 Apr 12 09:09:17 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-918812097", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "02dc198d-c79f-4def-869d-52fb8ff7dc23"}], "security_groups": [{"name": "tempest-securitygroup--1699146807"}], "key_name": "tempest-keypair-521589223", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-db61dfe4-d3b1-4fb7-a054-8406d7471291 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Action: 'create', calling method: .version_select at 0x7fbd5bf6f0a0>, body: {"keypair": {"name": "tempest-keypair-1729758921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhIEvy6u0ucraKFLAKUfRFmPWc1THTzkE+nKz5trKmDMVoQY5PQec7o8K/gFwTTmFODGDbFv4P9xU/YGnuWeTKYMN0cg2aCVtGTel1KJX/H1uLY/x5ICkLJGSItgbH6bQ=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:19 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] validate_networks() for [('02dc198d-c79f-4def-869d-52fb8ff7dc23', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:09:19 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}, {"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}, {"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}, {"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-plugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:19 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-db61dfe4-d3b1-4fb7-a054-8406d7471291 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Getting quotas for project c5768be2d4a446f4ac473502a0b909dc. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:19 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-db61dfe4-d3b1-4fb7-a054-8406d7471291 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Getting quotas for user 8ac61f1cb87d4ed5a488b2cff4a63375 and project c5768be2d4a446f4ac473502a0b909dc. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:09:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:09:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:09:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Creating event network-vif-plugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:09:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-db61dfe4-d3b1-4fb7-a054-8406d7471291 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.820576 Apr 12 09:09:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:09:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.234396 Apr 12 09:09:19 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:19 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:09:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:09:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:09:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:09:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=15 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting quotas for project dd9e7d6ece244a96b01277451a3ed5a5. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting quotas for user 8911ec7c959541989cce3870ba11fb80 and project dd9e7d6ece244a96b01277451a3ed5a5. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:09:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d6e5f3cb-b276-42cf-bbb8-31c7ede06837 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Action: 'create', calling method: .version_select at 0x7fbd5bf6cca0>, body: {"keypair": {"name": "tempest-keypair-591560650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=31 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:21 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d6e5f3cb-b276-42cf-bbb8-31c7ede06837 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Getting quotas for project ed443186516c4075ab14a4b0be130e31. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:21 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d6e5f3cb-b276-42cf-bbb8-31c7ede06837 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Getting quotas for user bc97c54107de479bade4014982d79287 and project ed443186516c4075ab14a4b0be130e31. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.773239 Apr 12 09:09:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:09:19 2023] POST /compute/v2.1/servers => generated 404 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:09:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d6e5f3cb-b276-42cf-bbb8-31c7ede06837 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.069740 Apr 12 09:09:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 30/88] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 09:09:21 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 09:09:21 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6f15a4d4-bbf8-4a7e-851a-bee69b5cac6c tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:21 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-6f15a4d4-bbf8-4a7e-851a-bee69b5cac6c tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:21 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-6f15a4d4-bbf8-4a7e-851a-bee69b5cac6c tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-6f15a4d4-bbf8-4a7e-851a-bee69b5cac6c tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035" status: 200 len: 1234 microversion: 2.1 time: 0.295679 Apr 12 09:09:21 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 30/89] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:21 2023] GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035 => generated 1234 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f40323-58a6-4e9c-b26b-23615dde13d3", "tag": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Creating event network-changed:d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 on user Apr 12 09:09:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055815 Apr 12 09:09:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 30/90] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-plugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Creating event network-vif-plugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:09:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130184 Apr 12 09:09:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2091699595", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843"}], "security_groups": [{"name": "tempest-securitygroup--1001521221"}], "key_name": "tempest-keypair-591560650", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f40323-58a6-4e9c-b26b-23615dde13d3", "name": "network-vif-plugged", "status": "completed", "tag": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Creating event network-vif-plugged:d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 on user Apr 12 09:09:26 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] validate_networks() for [('00c625ad-e5a3-4c0d-b3d2-7b78e9385843', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:09:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074468 Apr 12 09:09:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1504382156", "imageRef": "bcda072a-5430-47b7-b2b3-b29e054883ad", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "de15a39b-b186-4f7a-a0e1-40e8dad38f96"}], "security_groups": [{"name": "tempest-securitygroup--745779499"}], "key_name": "tempest-keypair-1729758921", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:27 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] validate_networks() for [('de15a39b-b186-4f7a-a0e1-40e8dad38f96', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=21 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Getting quotas for project ed443186516c4075ab14a4b0be130e31. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Getting quotas for user bc97c54107de479bade4014982d79287 and project ed443186516c4075ab14a4b0be130e31. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:09:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 2.110430 Apr 12 09:09:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 31/93] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 09:09:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f3a848c3-1162-4957-ab8d-625f704e1282 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f3a848c3-1162-4957-ab8d-625f704e1282 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f3a848c3-1162-4957-ab8d-625f704e1282 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f3a848c3-1162-4957-ab8d-625f704e1282 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f3a848c3-1162-4957-ab8d-625f704e1282 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f3a848c3-1162-4957-ab8d-625f704e1282 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 200 len: 1320 microversion: 2.49 time: 0.213078 Apr 12 09:09:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 32/94] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:09:28 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f40323-58a6-4e9c-b26b-23615dde13d3", "name": "network-vif-plugged", "status": "completed", "tag": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Creating event network-vif-plugged:d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 on user Apr 12 09:09:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149720 Apr 12 09:09:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Getting quotas for project c5768be2d4a446f4ac473502a0b909dc. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Getting quotas for user 8ac61f1cb87d4ed5a488b2cff4a63375 and project c5768be2d4a446f4ac473502a0b909dc. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:09:29 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcda072a-5430-47b7-b2b3-b29e054883ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:09:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.354197 Apr 12 09:09:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 32/96] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:09:27 2023] POST /compute/v2.1/servers => generated 403 bytes in 2357 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:09:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-46de6a9e-6d61-42a4-9168-755320775181 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:29 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-46de6a9e-6d61-42a4-9168-755320775181 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:29 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:29 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:29 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-19c125c5-cddb-4376-89c0-cef4e87851ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281" status: 200 len: 1691 microversion: 2.87 time: 1.073724 Apr 12 09:09:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 33/97] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:09:28 2023] GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281 => generated 1691 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:09:29 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-46de6a9e-6d61-42a4-9168-755320775181 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac61f1cb87d4ed5a488b2cff4a63375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5768be2d4a446f4ac473502a0b909dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-46de6a9e-6d61-42a4-9168-755320775181 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a" status: 200 len: 1240 microversion: 2.1 time: 0.442955 Apr 12 09:09:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 33/98] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:29 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a => generated 1240 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0bc5da-ed98-417a-9fc1-1f636887f035", "tag": "473a9253-5ee7-4ef1-bd1a-f260bc80b158"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Creating event network-changed:473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 on user Apr 12 09:09:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044784 Apr 12 09:09:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0bc5da-ed98-417a-9fc1-1f636887f035", "name": "network-vif-plugged", "status": "completed", "tag": "473a9253-5ee7-4ef1-bd1a-f260bc80b158"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Creating event network-vif-plugged:473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 on user Apr 12 09:09:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080805 Apr 12 09:09:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22eabe74-0932-472e-8090-09e8431f4f4a", "tag": "f3af3839-bbd2-4152-ab34-91c767220af4"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Creating event network-changed:f3af3839-bbd2-4152-ab34-91c767220af4 for instance 22eabe74-0932-472e-8090-09e8431f4f4a on user Apr 12 09:09:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214131 Apr 12 09:09:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "tag": "c7ccda6d-74db-4747-a5eb-dba5e82506fa"}, {"server_uuid": "1d0bc5da-ed98-417a-9fc1-1f636887f035", "name": "network-vif-plugged", "status": "completed", "tag": "473a9253-5ee7-4ef1-bd1a-f260bc80b158"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Creating event network-changed:c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:09:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Creating event network-vif-plugged:473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 on user Apr 12 09:09:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081661 Apr 12 09:09:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c83f4cc5-3328-4d4f-9153-654efcfc3bcb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Action: 'create', calling method: .version_select at 0x7fbd5bf6d900>, body: {"keypair": {"name": "tempest-TestStampPattern-1475014031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fsSS3XTWnvMjjcXo2M/eSLvS9TQwtC5Vw9sxk2wzTZ75i0he3Eo6b0vT0HPmDlWDm3m80IrirjqBjUz0Z8GQDLK2hw+EpHpQKcspVFgKhBnSTs/WZpB6phNQXZtwf0w=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:37 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-c83f4cc5-3328-4d4f-9153-654efcfc3bcb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting quotas for project 81d39dd859ed4684a659c79ca3ea3fb4. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:37 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-c83f4cc5-3328-4d4f-9153-654efcfc3bcb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting quotas for user e0440debc9af46e690788752e32f0912 and project 81d39dd859ed4684a659c79ca3ea3fb4. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c83f4cc5-3328-4d4f-9153-654efcfc3bcb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.361944 Apr 12 09:09:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:09:37 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:39 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-plugged", "status": "completed", "tag": "c7ccda6d-74db-4747-a5eb-dba5e82506fa"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Creating event network-vif-plugged:c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:09:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092011 Apr 12 09:09:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eabe74-0932-472e-8090-09e8431f4f4a", "name": "network-vif-plugged", "status": "completed", "tag": "f3af3839-bbd2-4152-ab34-91c767220af4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Creating event network-vif-plugged:f3af3839-bbd2-4152-ab34-91c767220af4 for instance 22eabe74-0932-472e-8090-09e8431f4f4a on user Apr 12 09:09:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092245 Apr 12 09:09:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 36/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-plugged", "status": "completed", "tag": "c7ccda6d-74db-4747-a5eb-dba5e82506fa"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Creating event network-vif-plugged:c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:09:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048131 Apr 12 09:09:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:09:41 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:41 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-33778613", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1475014031", "security_groups": [{"name": "tempest-secgroup-smoke-58328323"}], "networks": [{"uuid": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:41 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:41 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] validate_networks() for [('891ebcc8-f6c9-4839-b624-dd5a9a1a7abd', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting quotas for project 81d39dd859ed4684a659c79ca3ea3fb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting quotas for user e0440debc9af46e690788752e32f0912 and project 81d39dd859ed4684a659c79ca3ea3fb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:09:42 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:09:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.028111 Apr 12 09:09:42 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 36/107] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:09:41 2023] POST /compute/v2.1/servers => generated 402 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:09:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eb1fd604-534c-460b-9d12-96db2acbae83 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:42 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-eb1fd604-534c-460b-9d12-96db2acbae83 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:42 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-eb1fd604-534c-460b-9d12-96db2acbae83 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-eb1fd604-534c-460b-9d12-96db2acbae83 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955" status: 200 len: 1235 microversion: 2.1 time: 0.110639 Apr 12 09:09:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 37/108] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:42 2023] GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955 => generated 1235 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eabe74-0932-472e-8090-09e8431f4f4a", "name": "network-vif-plugged", "status": "completed", "tag": "f3af3839-bbd2-4152-ab34-91c767220af4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Creating event network-vif-plugged:f3af3839-bbd2-4152-ab34-91c767220af4 for instance 22eabe74-0932-472e-8090-09e8431f4f4a on user Apr 12 09:09:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043545 Apr 12 09:09:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:44 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a651c616da4b3b98a71a43b07512d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93767066d345a081bd30ca6d52ccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-6b9851e9-3fd3-4ef6-b4f9-6c34bdf90ebb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" status: 200 len: 1490 microversion: 2.1 time: 0.402167 Apr 12 09:09:45 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:44 2023] GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => generated 1490 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:46 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-43aa8c7c-fc6c-4892-a4bd-84c3cd097f99 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1537 microversion: 2.1 time: 0.292759 Apr 12 09:09:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 38/111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:46 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Creating event network-changed:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:09:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051195 Apr 12 09:09:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 37/112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "name": "network-vif-plugged", "status": "completed", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Creating event network-vif-plugged:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:09:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053283 Apr 12 09:09:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:09:50 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-cfa7f7ed-676d-4754-8b50-7e489452ab4b tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1535 microversion: 2.1 time: 0.700008 Apr 12 09:09:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:49 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1535 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=13 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:50 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:09:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b495b08a-ef11-4aa0-ab4c-7bd38eeff2c7 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8" status: 200 len: 1503 microversion: 2.1 time: 0.265881 Apr 12 09:09:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 38/115] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:09:50 2023] GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:09:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "name": "network-vif-plugged", "status": "completed", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:09:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:09:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:09:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:09:52 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=26 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:09:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Creating event network-vif-plugged:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:09:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047332 Apr 12 09:09:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=21 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:07 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9257c2223d417298b5927f7b99ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f74eae85c24a72a048bdd03e4d4f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:07 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-42401d8b-7a00-476c-8c29-aa3226f3329f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3" status: 200 len: 1523 microversion: 2.1 time: 0.142100 Apr 12 09:10:07 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 39/117] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:07 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3 => generated 1523 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=5 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:11 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-24911684-c64d-4d05-9818-bf6ac65dab5d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035" status: 200 len: 1545 microversion: 2.1 time: 0.161752 Apr 12 09:10:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:11 2023] GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035 => generated 1545 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:18 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a6064978-16b0-490d-9c79-83e1ce57ef7e tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 200 len: 1628 microversion: 2.49 time: 0.209143 Apr 12 09:10:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 41/119] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:10:18 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 1628 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:20 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac61f1cb87d4ed5a488b2cff4a63375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5768be2d4a446f4ac473502a0b909dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-48a0c806-0ada-4d75-a477-d99ea2d7a803 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a" status: 200 len: 1549 microversion: 2.1 time: 0.141495 Apr 12 09:10:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:20 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a => generated 1549 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1575729754"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281/action" status: 202 len: 52 microversion: 2.87 time: 0.992765 Apr 12 09:10:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 40/121] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:10:29 2023] POST /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281/action => generated 52 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:33 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-febc9015-e9d5-45ed-82ef-43559c8c4832 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955" status: 200 len: 1536 microversion: 2.1 time: 0.558753 Apr 12 09:10:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 42/122] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:32 2023] GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955 => generated 1536 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-556974a2-8b73-44e2-a745-f9ac9903fb2c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281" status: 200 len: 1691 microversion: 2.87 time: 0.212493 Apr 12 09:10:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 41/123] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:10:36 2023] GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281 => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66411b86-ffc7-4ced-840e-8fe743302ed1"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-09ad3d92-dd65-450e-bff0-21acec0a01ca tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.142467 Apr 12 09:10:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 43/124] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:10:46 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-interface => generated 282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706529 Apr 12 09:10:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 41/125] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:10:46 2023] POST /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:48 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:48 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:10:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Creating event network-changed:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:10:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039772 Apr 12 09:10:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:48 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-bf92bd24-3662-47ca-affe-08ffb2a9b600 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1537 microversion: 2.1 time: 0.258820 Apr 12 09:10:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 44/127] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:48 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1537 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:48 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6edd6bec-094f-4eab-9446-80e0acedcbb2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1537 microversion: 2.1 time: 0.244546 Apr 12 09:10:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:48 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-42bc511b-a8ff-47fd-b8ed-bf8186710c4f tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.330704 Apr 12 09:10:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 43/129] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:10:50 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-interface => generated 282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:50 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:10:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8/action" status: 200 len: 32 microversion: 2.1 time: 0.150128 Apr 12 09:10:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 45/130] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:10:50 2023] POST /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:51 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:51 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b184875a-7f56-4e09-80eb-2169ebbc8d78 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8" status: 200 len: 1509 microversion: 2.1 time: 0.214563 Apr 12 09:10:51 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:50 2023] GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-unplugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Creating event network-vif-unplugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:10:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038671 Apr 12 09:10:51 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:10:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7433346a-0848-4a20-9f53-8ad76f027d01 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/ips" status: 200 len: 104 microversion: 2.1 time: 0.061943 Apr 12 09:10:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 46/133] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:10:52 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/ips => generated 104 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a058b665-da02-444b-8e77-862141ce3a61"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:53 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}, {"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-plugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:53 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Creating event network-changed:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:10:53 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Creating event network-vif-plugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:10:53 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047103 Apr 12 09:10:53 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:10:53 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363560 Apr 12 09:10:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 44/135] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:10:53 2023] POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:55 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:10:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" status: 204 len: 0 microversion: 2.1 time: 0.127886 Apr 12 09:10:55 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 47/136] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:10:55 2023] DELETE /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:10:55 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:10:55 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:10:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-plugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}, {"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-plugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:56 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Creating event network-vif-plugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:10:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Creating event network-vif-plugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:10:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038401 Apr 12 09:10:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 45/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:56 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a651c616da4b3b98a71a43b07512d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93767066d345a081bd30ca6d52ccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:10:56 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-59f36ac9-7c15-4615-8c48-a80b5aa797fb tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" status: 200 len: 1542 microversion: 2.1 time: 0.275281 Apr 12 09:10:56 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:10:55 2023] GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => generated 1542 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:10:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185", "name": "network-vif-unplugged", "status": "completed", "tag": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Creating event network-vif-unplugged:04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 on user Apr 12 09:10:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046398 Apr 12 09:10:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 48/139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:10:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:10:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185", "name": "network-vif-plugged", "status": "completed", "tag": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700"}, {"server_uuid": "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185", "name": "network-vif-deleted", "tag": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:10:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:10:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:10:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:10:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Creating event network-vif-plugged:04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 on user Apr 12 09:10:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Creating event network-vif-deleted:04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 on user Apr 12 09:10:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033333 Apr 12 09:10:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:10:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:01 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Going to try to stop instance {{(pid=61855) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 09:11:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action" status: 202 len: 0 microversion: 2.1 time: 0.104584 Apr 12 09:11:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 47/141] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:11:01 2023] POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:02 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c24b383c-be1e-4ca5-9891-20d07bc9f818 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1710 microversion: 2.1 time: 0.180747 Apr 12 09:11:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 49/142] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:01 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1710 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:11:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-unplugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Creating event network-vif-unplugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:11:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032768 Apr 12 09:11:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:04 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:11:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028108 Apr 12 09:11:04 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 48/144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-dc9c5116-6d5c-47a2-be88-6716e3f06baf tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.085876 Apr 12 09:11:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 50/145] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:11:07 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-interface => generated 282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f40323-58a6-4e9c-b26b-23615dde13d3", "tag": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Creating event network-changed:d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 on user Apr 12 09:11:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033477 Apr 12 09:11:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "297e37c3-cfa1-4064-98b5-4565c088c320"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302170 Apr 12 09:11:09 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 49/147] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:11:09 2023] POST /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d8d82c9c-b1c2-4a6a-ad4b-4ea45a0c9233 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.080202 Apr 12 09:11:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 51/148] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:11:11 2023] GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-interface => generated 283 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0bc5da-ed98-417a-9fc1-1f636887f035", "tag": "473a9253-5ee7-4ef1-bd1a-f260bc80b158"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Creating event network-changed:473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 on user Apr 12 09:11:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034195 Apr 12 09:11:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 49/149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "711ec528-9d10-4441-99fd-7bd08c524292"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281278 Apr 12 09:11:14 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 50/150] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:11:14 2023] POST /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8efa7873-7011-4a2d-9e41-54b8ed92441a"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments/297e37c3-cfa1-4064-98b5-4565c088c320" status: 202 len: 0 microversion: 2.1 time: 0.526263 Apr 12 09:11:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 52/151] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 09:11:16 2023] PUT /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments/297e37c3-cfa1-4064-98b5-4565c088c320 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=19 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a5af8a41-5181-4ecf-86aa-32180841c588 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.098952 Apr 12 09:11:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 50/152] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 09:11:18 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-interface => generated 283 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=19 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "tag": "c7ccda6d-74db-4747-a5eb-dba5e82506fa"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Creating event network-changed:c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:11:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034415 Apr 12 09:11:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 53/153] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f8f4a9a6-7c18-44f4-81f1-bf6fd0552862 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.131811 Apr 12 09:11:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:11:20 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-interface => generated 283 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:20 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-afb29728-77d7-4c1a-b912-96861a357c54 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 200 len: 1628 microversion: 2.49 time: 0.459981 Apr 12 09:11:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 51/155] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:11:20 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 1628 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "tag": "nic-tag"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:21 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22eabe74-0932-472e-8090-09e8431f4f4a", "tag": "f3af3839-bbd2-4152-ab34-91c767220af4"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Creating event network-changed:f3af3839-bbd2-4152-ab34-91c767220af4 for instance 22eabe74-0932-472e-8090-09e8431f4f4a on user Apr 12 09:11:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043206 Apr 12 09:11:21 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "tag": "15e598ed-6d82-4978-9ea7-57da256807b3"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Creating event network-changed:15e598ed-6d82-4978-9ea7-57da256807b3 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:11:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030587 Apr 12 09:11:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 52/157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e4efab7-f288-474b-8263-3dd11305b630"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "764d5110-866f-4b11-8414-c026f53a5525"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "POST /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387624 Apr 12 09:11:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 53/158] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:11:24 2023] POST /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-plugged", "status": "completed", "tag": "15e598ed-6d82-4978-9ea7-57da256807b3"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] HTTP exception thrown: Volume 764d5110-866f-4b11-8414-c026f53a5525 could not be found. Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Request method failure captured: Apr 12 09:11:24 user devstack@n-api.service[61854]: request: PUT /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments/711ec528-9d10-4441-99fd-7bd08c524292 HTTP/1.1 Apr 12 09:11:24 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:11:24 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:11:24 user devstack@n-api.service[61854]: Connection: close Apr 12 09:11:24 user devstack@n-api.service[61854]: Content-Length: 74 Apr 12 09:11:24 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:11:24 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:11:24 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:11:24 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnU2i-hBU3cVR6t9w92oxWL2EOykFt-x2tDrKwSTEYkMqy1pN9pQpycISQT71JK-8Avb7pl-5B5DtI089s1xMLKV1o1HVPdoR33fL9dSjQguWdRx_lGihyw_70YRJ06qK--F-1legvv7ivUvZnYt0cWjBG9-FU8zSC1xZfsd-3pzjOQ Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Project-Id: 46e809df74f24a92bd8caa5887b55a9d Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesAdminNegativeTest-1559680739 Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Role: reader,admin,member Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Roles: reader,admin,member Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46e809df74f24a92bd8caa5887b55a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46e809df74f24a92bd8caa5887b55a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46e809df74f24a92bd8caa5887b55a9d"}]}] Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesAdminNegativeTest-1559680739 Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Tenant-Id: 46e809df74f24a92bd8caa5887b55a9d Apr 12 09:11:24 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1559680739 Apr 12 09:11:24 user devstack@n-api.service[61854]: X-User: tempest-VolumesAdminNegativeTest-1559680739-project-admin Apr 12 09:11:24 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:11:24 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:11:24 user devstack@n-api.service[61854]: X-User-Id: 045d1fd9c7784431a5182a1cf7255268 Apr 12 09:11:24 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesAdminNegativeTest-1559680739-project-admin Apr 12 09:11:24 user devstack@n-api.service[61854]: Apr 12 09:11:24 user devstack@n-api.service[61854]: {"volumeAttachment": {"volumeId": "764d5110-866f-4b11-8414-c026f53a5525"}} Apr 12 09:11:24 user devstack@n-api.service[61854]: method: > Apr 12 09:11:24 user devstack@n-api.service[61854]: exception: Volume 764d5110-866f-4b11-8414-c026f53a5525 could not be found. Apr 12 09:11:24 user devstack@n-api.service[61854]: action_args: {'server_id': '1d0bc5da-ed98-417a-9fc1-1f636887f035', 'id': '711ec528-9d10-4441-99fd-7bd08c524292', 'body': {'volumeAttachment': {'volumeId': '764d5110-866f-4b11-8414-c026f53a5525'}}} Apr 12 09:11:24 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 764d5110-866f-4b11-8414-c026f53a5525 could not be found. (HTTP 404) (Request-ID: req-b500a425-ab61-4ec4-a51b-2244500a99ea) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 764d5110-866f-4b11-8414-c026f53a5525 could not be found. Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 764d5110-866f-4b11-8414-c026f53a5525 could not be found. Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 764d5110-866f-4b11-8414-c026f53a5525 could not be found. Apr 12 09:11:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Returning 400 to user: Volume 764d5110-866f-4b11-8414-c026f53a5525 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:11:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a9c7c09b-b436-45e2-94f6-20722961d85c tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments/711ec528-9d10-4441-99fd-7bd08c524292" status: 400 len: 107 microversion: 2.1 time: 0.404083 Apr 12 09:11:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 53/159] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 09:11:24 2023] PUT /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments/711ec528-9d10-4441-99fd-7bd08c524292 => generated 107 bytes in 407 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Creating event network-vif-plugged:15e598ed-6d82-4978-9ea7-57da256807b3 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:11:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051153 Apr 12 09:11:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 54/160] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'services' on Instance uuid 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:11:25 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments/711ec528-9d10-4441-99fd-7bd08c524292" status: 202 len: 0 microversion: 2.1 time: 0.414524 Apr 12 09:11:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 54/161] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:11:24 2023] DELETE /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments/711ec528-9d10-4441-99fd-7bd08c524292 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:11:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-interface" status: 200 len: 283 microversion: 2.49 time: 4.348342 Apr 12 09:11:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 54/162] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 09:11:20 2023] POST /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-interface => generated 283 bytes in 4350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4807592-9afe-402c-b7b4-68ce06c585da", "tag": "volume-tag"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:25 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e9f0ab53-82b7-4967-8031-5230981773d0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109121 Apr 12 09:11:25 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 55/163] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:25 2023] GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.520775 Apr 12 09:11:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 55/164] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 09:11:25 2023] POST /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:11:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-plugged", "status": "completed", "tag": "15e598ed-6d82-4978-9ea7-57da256807b3"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Creating event network-vif-plugged:15e598ed-6d82-4978-9ea7-57da256807b3 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:11:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056021 Apr 12 09:11:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4b76c6e5-5170-4291-af68-6959981e208f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Apr 12 09:11:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 56/166] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:31 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e6dfc0c2-d1e5-435e-88ed-bc98ed05ce4f tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Apr 12 09:11:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:31 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "297e37c3-cfa1-4064-98b5-4565c088c320"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments/8efa7873-7011-4a2d-9e41-54b8ed92441a" status: 202 len: 0 microversion: 2.1 time: 0.306443 Apr 12 09:11:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 56/168] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 09:11:31 2023] PUT /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments/8efa7873-7011-4a2d-9e41-54b8ed92441a => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:33 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:33 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-535b01d8-7c17-4657-9aee-fe318fb18881 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955" status: 200 len: 1536 microversion: 2.1 time: 0.144953 Apr 12 09:11:33 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:33 2023] GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955 => generated 1536 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Creating event network-changed:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:11:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030675 Apr 12 09:11:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 57/170] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0b83cb76-0b91-420d-b757-8a3e517ac16c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050020 Apr 12 09:11:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:35 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4531b054-1af7-4630-8d73-8f1bac8a7723"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:35 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lazy-loading 'services' on Instance uuid 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:11:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments/0e4efab7-f288-474b-8263-3dd11305b630" status: 202 len: 0 microversion: 2.1 time: 0.253980 Apr 12 09:11:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:11:35 2023] DELETE /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments/0e4efab7-f288-474b-8263-3dd11305b630 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:11:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277123 Apr 12 09:11:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 58/173] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:11:35 2023] POST /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1955348970", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] validate_networks() for [('a0210d9b-0f71-4647-9f96-c9cbe32cc3d8', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:11:36 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for user cc51704e74b045ad9733a43aec982390 and project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:11:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:11:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.570258 Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 58/174] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 09:11:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:11:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-86381840-4846-4792-9c8d-86e2c9d240cd tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-86381840-4846-4792-9c8d-86e2c9d240cd tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:37 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-86381840-4846-4792-9c8d-86e2c9d240cd tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:37 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-86381840-4846-4792-9c8d-86e2c9d240cd tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:37 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-86381840-4846-4792-9c8d-86e2c9d240cd tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-86381840-4846-4792-9c8d-86e2c9d240cd tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 200 len: 1395 microversion: 2.87 time: 0.080337 Apr 12 09:11:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 59/175] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:11:37 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 1395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:11:37 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'services' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:11:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-volume_attachments/e4807592-9afe-402c-b7b4-68ce06c585da" status: 202 len: 0 microversion: 2.49 time: 0.199645 Apr 12 09:11:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 59/176] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 09:11:37 2023] DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-volume_attachments/e4807592-9afe-402c-b7b4-68ce06c585da => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b73b5213-ea59-45bc-81ef-1e418ca9d05c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1655 microversion: 2.1 time: 0.411086 Apr 12 09:11:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 59/177] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:38 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1655 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-374c8c4c-9bf8-4400-ba59-4fe02a354a1b tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104081 Apr 12 09:11:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:39 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5af4225a-1c81-4bf3-97ba-86fe1a3fc4ad tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065608 Apr 12 09:11:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:39 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:11:39 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4e28f8af-e554-4daa-8fe5-ee9ef5e15faf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1655 microversion: 2.1 time: 0.376230 Apr 12 09:11:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 60/180] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:39 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1655 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:11:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a" status: 204 len: 0 microversion: 2.1 time: 0.183527 Apr 12 09:11:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 61/181] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:11:39 2023] DELETE /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eabe74-0932-472e-8090-09e8431f4f4a", "name": "network-vif-unplugged", "status": "completed", "tag": "f3af3839-bbd2-4152-ab34-91c767220af4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Creating event network-vif-unplugged:f3af3839-bbd2-4152-ab34-91c767220af4 for instance 22eabe74-0932-472e-8090-09e8431f4f4a on user Apr 12 09:11:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039454 Apr 12 09:11:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 61/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-interface/15e598ed-6d82-4978-9ea7-57da256807b3" status: 202 len: 0 microversion: 2.49 time: 0.063494 Apr 12 09:11:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 62/183] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 09:11:40 2023] DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-interface/15e598ed-6d82-4978-9ea7-57da256807b3 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:11:40 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac61f1cb87d4ed5a488b2cff4a63375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5768be2d4a446f4ac473502a0b909dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e29da574-e0f9-466f-985f-54653aca1825 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a" status: 200 len: 1674 microversion: 2.1 time: 0.873041 Apr 12 09:11:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:40 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a => generated 1674 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Creating event network-changed:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:11:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061371 Apr 12 09:11:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 62/185] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:11:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-681212b8-b25e-484c-98ec-f782c2d4f344 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-instance-actions/req-527aac22-7623-4668-8b9d-b652822fdddc" status: 200 len: 474 microversion: 2.49 time: 0.354288 Apr 12 09:11:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 62/186] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 09:11:40 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-instance-actions/req-527aac22-7623-4668-8b9d-b652822fdddc => generated 474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-unplugged", "status": "completed", "tag": "15e598ed-6d82-4978-9ea7-57da256807b3"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Creating event network-vif-unplugged:15e598ed-6d82-4978-9ea7-57da256807b3 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:11:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046066 Apr 12 09:11:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 63/187] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:11:41 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-44e96393-1b04-4d26-bd69-840dea68c12c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8" status: 200 len: 1489 microversion: 2.1 time: 0.544798 Apr 12 09:11:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:41 2023] GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 => generated 1489 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:11:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eabe74-0932-472e-8090-09e8431f4f4a", "name": "network-vif-plugged", "status": "completed", "tag": "f3af3839-bbd2-4152-ab34-91c767220af4"}, {"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-deleted", "tag": "15e598ed-6d82-4978-9ea7-57da256807b3"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Creating event network-vif-plugged:f3af3839-bbd2-4152-ab34-91c767220af4 for instance 22eabe74-0932-472e-8090-09e8431f4f4a on user Apr 12 09:11:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Creating event network-vif-deleted:15e598ed-6d82-4978-9ea7-57da256807b3 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:11:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045350 Apr 12 09:11:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 63/189] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:11:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-8b80aae7-b880-4a1b-82fa-238816a92d0d req-b3ac57a6-7cb3-4f43-81ef-c4180ace4805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eabe74-0932-472e-8090-09e8431f4f4a", "name": "network-vif-deleted", "tag": "f3af3839-bbd2-4152-ab34-91c767220af4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8b80aae7-b880-4a1b-82fa-238816a92d0d req-b3ac57a6-7cb3-4f43-81ef-c4180ace4805 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8b80aae7-b880-4a1b-82fa-238816a92d0d req-b3ac57a6-7cb3-4f43-81ef-c4180ace4805 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8b80aae7-b880-4a1b-82fa-238816a92d0d req-b3ac57a6-7cb3-4f43-81ef-c4180ace4805 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8b80aae7-b880-4a1b-82fa-238816a92d0d req-b3ac57a6-7cb3-4f43-81ef-c4180ace4805 service nova] Creating event network-vif-deleted:f3af3839-bbd2-4152-ab34-91c767220af4 for instance 22eabe74-0932-472e-8090-09e8431f4f4a on user Apr 12 09:11:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-8b80aae7-b880-4a1b-82fa-238816a92d0d req-b3ac57a6-7cb3-4f43-81ef-c4180ace4805 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029214 Apr 12 09:11:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 64/190] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-plugged", "status": "completed", "tag": "15e598ed-6d82-4978-9ea7-57da256807b3"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Creating event network-vif-plugged:15e598ed-6d82-4978-9ea7-57da256807b3 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:11:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027066 Apr 12 09:11:43 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 64/191] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9095dabf-c5d1-4fc6-b93d-441bef7656b4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Apr 12 09:11:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:44 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-96731777-8838-4be4-884d-42723b55d3ea tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056422 Apr 12 09:11:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 65/193] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:44 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:44 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:44 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:45 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:45 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lazy-loading 'services' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'services' on Instance uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:11:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments/4531b054-1af7-4630-8d73-8f1bac8a7723" status: 202 len: 0 microversion: 2.1 time: 0.175482 Apr 12 09:11:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:11:45 2023] DELETE /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments/4531b054-1af7-4630-8d73-8f1bac8a7723 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments/297e37c3-cfa1-4064-98b5-4565c088c320" status: 202 len: 0 microversion: 2.1 time: 0.234056 Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:45 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 65/195] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:11:44 2023] DELETE /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments/297e37c3-cfa1-4064-98b5-4565c088c320 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d2e7b821-f81c-4076-8264-6d54637b1ce2 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Apr 12 09:11:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:45 2023] GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:45 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4a3ad7bc-efc8-47b5-8ff4-c7b74bb113f4 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076164 Apr 12 09:11:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:45 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] HTTP exception thrown: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Request method failure captured: Apr 12 09:11:46 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 HTTP/1.1 Apr 12 09:11:46 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:11:46 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:11:46 user devstack@n-api.service[61855]: Connection: close Apr 12 09:11:46 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:11:46 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:11:46 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:11:46 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:11:46 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUkIJvwue-GLwPPRujPB9-oGz2lLN40vWcfSbbjZvwY5Tvpe4g3jZcp7BlTQEC2C9WMLPoB96ISVWtK-S0a-YXi8CLyz2uWd_G_uhucJOBoWlpNvYn7Gnf4hRHwu8RmTs1uS2z2-XL-1mlolycI4clww2Ew2IW-XW8PejGA0RnD15g Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Project-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Project-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}] Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Tenant: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Tenant-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:46 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:46 user devstack@n-api.service[61855]: X-User: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:46 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:11:46 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:11:46 user devstack@n-api.service[61855]: X-User-Id: 69a651c616da4b3b98a71a43b07512d9 Apr 12 09:11:46 user devstack@n-api.service[61855]: X-User-Name: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:46 user devstack@n-api.service[61855]: method: > Apr 12 09:11:46 user devstack@n-api.service[61855]: exception: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:46 user devstack@n-api.service[61855]: action_args: {'id': '9c107ac6-adbb-4e6d-835a-4f6e7fa6f185'} Apr 12 09:11:46 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:46 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Returning 404 to user: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:11:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-56216f1e-7dd8-4174-8514-51ecbfc037b2 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" status: 404 len: 111 microversion: 2.1 time: 0.033274 Apr 12 09:11:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 66/198] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:46 2023] GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] HTTP exception thrown: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Request method failure captured: Apr 12 09:11:47 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/os-volume_attachments HTTP/1.1 Apr 12 09:11:47 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:11:47 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:11:47 user devstack@n-api.service[61853]: Connection: close Apr 12 09:11:47 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:11:47 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:11:47 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:11:47 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:11:47 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUkIJvwue-GLwPPRujPB9-oGz2lLN40vWcfSbbjZvwY5Tvpe4g3jZcp7BlTQEC2C9WMLPoB96ISVWtK-S0a-YXi8CLyz2uWd_G_uhucJOBoWlpNvYn7Gnf4hRHwu8RmTs1uS2z2-XL-1mlolycI4clww2Ew2IW-XW8PejGA0RnD15g Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Project-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Project-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}] Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Tenant: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Tenant-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:47 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:47 user devstack@n-api.service[61853]: X-User: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:47 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:11:47 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:11:47 user devstack@n-api.service[61853]: X-User-Id: 69a651c616da4b3b98a71a43b07512d9 Apr 12 09:11:47 user devstack@n-api.service[61853]: X-User-Name: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:47 user devstack@n-api.service[61853]: method: > Apr 12 09:11:47 user devstack@n-api.service[61853]: exception: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:47 user devstack@n-api.service[61853]: action_args: {'server_id': '9c107ac6-adbb-4e6d-835a-4f6e7fa6f185'} Apr 12 09:11:47 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:11:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Returning 404 to user: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:11:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c1064444-2eb0-4cce-b048-6125bfb9c4e0 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042205 Apr 12 09:11:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:11:47 2023] GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=38 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] HTTP exception thrown: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Request method failure captured: Apr 12 09:11:49 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 HTTP/1.1 Apr 12 09:11:49 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:11:49 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:11:49 user devstack@n-api.service[61854]: Connection: close Apr 12 09:11:49 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:11:49 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:11:49 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:11:49 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:11:49 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUkIJvwue-GLwPPRujPB9-oGz2lLN40vWcfSbbjZvwY5Tvpe4g3jZcp7BlTQEC2C9WMLPoB96ISVWtK-S0a-YXi8CLyz2uWd_G_uhucJOBoWlpNvYn7Gnf4hRHwu8RmTs1uS2z2-XL-1mlolycI4clww2Ew2IW-XW8PejGA0RnD15g Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Project-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Project-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}] Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Tenant: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Tenant-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:49 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:49 user devstack@n-api.service[61854]: X-User: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:49 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:11:49 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:11:49 user devstack@n-api.service[61854]: X-User-Id: 69a651c616da4b3b98a71a43b07512d9 Apr 12 09:11:49 user devstack@n-api.service[61854]: X-User-Name: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:49 user devstack@n-api.service[61854]: method: > Apr 12 09:11:49 user devstack@n-api.service[61854]: exception: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61854]: action_args: {'id': '9c107ac6-adbb-4e6d-835a-4f6e7fa6f185'} Apr 12 09:11:49 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Returning 404 to user: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:11:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cdc8ea23-2e76-4358-b3f4-b9aee0e9622e tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" status: 404 len: 111 microversion: 2.1 time: 0.046024 Apr 12 09:11:49 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:11:49 2023] DELETE /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:49 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] HTTP exception thrown: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Request method failure captured: Apr 12 09:11:49 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 HTTP/1.1 Apr 12 09:11:49 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:11:49 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:11:49 user devstack@n-api.service[61855]: Connection: close Apr 12 09:11:49 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:11:49 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:11:49 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:11:49 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:11:49 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUkIJvwue-GLwPPRujPB9-oGz2lLN40vWcfSbbjZvwY5Tvpe4g3jZcp7BlTQEC2C9WMLPoB96ISVWtK-S0a-YXi8CLyz2uWd_G_uhucJOBoWlpNvYn7Gnf4hRHwu8RmTs1uS2z2-XL-1mlolycI4clww2Ew2IW-XW8PejGA0RnD15g Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Project-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Project-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c93767066d345a081bd30ca6d52ccd3"}]}] Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Tenant: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Tenant-Id: 2c93767066d345a081bd30ca6d52ccd3 Apr 12 09:11:49 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-DeleteServersTestJSON-821159716 Apr 12 09:11:49 user devstack@n-api.service[61855]: X-User: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:49 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:11:49 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:11:49 user devstack@n-api.service[61855]: X-User-Id: 69a651c616da4b3b98a71a43b07512d9 Apr 12 09:11:49 user devstack@n-api.service[61855]: X-User-Name: tempest-DeleteServersTestJSON-821159716-project-member Apr 12 09:11:49 user devstack@n-api.service[61855]: method: > Apr 12 09:11:49 user devstack@n-api.service[61855]: exception: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61855]: action_args: {'id': '9c107ac6-adbb-4e6d-835a-4f6e7fa6f185'} Apr 12 09:11:49 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. Apr 12 09:11:49 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:11:49 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Returning 404 to user: Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:11:49 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d92d82e7-3049-431b-a440-9a174e972979 tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" status: 404 len: 111 microversion: 2.1 time: 0.031646 Apr 12 09:11:49 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:49 2023] GET /compute/v2.1/servers/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:11:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0a7d3b42-7186-4bc6-b079-bd42de4916ca tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1687 microversion: 2.1 time: 0.194352 Apr 12 09:11:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:11:52 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:11:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:11:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029403 Apr 12 09:11:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 68/203] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:11:55 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:11:55 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:11:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:11:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:11:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:11:55 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:11:55 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032469 Apr 12 09:11:55 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 68/204] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:11:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6023cfde-c0fa-40cc-9d3a-aae11dac3f33 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Action: 'create', calling method: .version_select at 0x7fbd5ba00430>, body: {"keypair": {"name": "tempest-keypair-681767073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4vJjgMKDKaWr0Dy8W2bVCeXaYOmTVfeTv9/3UEUmN+6itpsXzbaWpnFjPJUdjwFtuYYeFZdZPUeplH0aO/nZtpvGeDHXHuXoefAJJIu7CBy1InWrkCMQqKrIm1eU6g5A=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:00 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-6023cfde-c0fa-40cc-9d3a-aae11dac3f33 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Getting quotas for project 28ede6e9cdbc4b71a1affaddfd1ad9a3. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:12:00 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-6023cfde-c0fa-40cc-9d3a-aae11dac3f33 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Getting quotas for user d9afc908ad0e4ba9ab74006817cc0895 and project 28ede6e9cdbc4b71a1affaddfd1ad9a3. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:12:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6023cfde-c0fa-40cc-9d3a-aae11dac3f33 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149055 Apr 12 09:12:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 69/205] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:12:00 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-430343469", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "a113fe76-9546-4c8d-9c26-762c017f777f"}], "security_groups": [{"name": "tempest-securitygroup--66004929"}], "key_name": "tempest-keypair-681767073", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:01 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] validate_networks() for [('a113fe76-9546-4c8d-9c26-762c017f777f', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Getting quotas for project 28ede6e9cdbc4b71a1affaddfd1ad9a3. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Getting quotas for user d9afc908ad0e4ba9ab74006817cc0895 and project 28ede6e9cdbc4b71a1affaddfd1ad9a3. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:12:02 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:12:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.548158 Apr 12 09:12:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 69/206] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:12:01 2023] POST /compute/v2.1/servers => generated 402 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:12:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6b11ae59-ae1c-4217-805a-30730bf92a92 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:02 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-6b11ae59-ae1c-4217-805a-30730bf92a92 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:02 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-6b11ae59-ae1c-4217-805a-30730bf92a92 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:02 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-6b11ae59-ae1c-4217-805a-30730bf92a92 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 200 len: 1238 microversion: 2.1 time: 0.072434 Apr 12 09:12:02 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 69/207] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:02 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:04 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Creating event network-changed:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:12:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032254 Apr 12 09:12:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:12:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036308 Apr 12 09:12:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 70/209] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:12:08 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:08 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:12:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033798 Apr 12 09:12:08 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 70/210] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2c1618fb-02c0-4072-876c-e83cd8558d4d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047179 Apr 12 09:12:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 71/211] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:12:15 2023] GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:12:15 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:15 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-904443664", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "02dc198d-c79f-4def-869d-52fb8ff7dc23"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:15 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] validate_networks() for [('02dc198d-c79f-4def-869d-52fb8ff7dc23', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting quotas for project dd9e7d6ece244a96b01277451a3ed5a5. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting quotas for user 8911ec7c959541989cce3870ba11fb80 and project dd9e7d6ece244a96b01277451a3ed5a5. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:12:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:12:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.534115 Apr 12 09:12:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:12:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:12:16 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:16 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-04d35a49-6736-4c3c-82cb-900fd48d86f8 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:16 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-04d35a49-6736-4c3c-82cb-900fd48d86f8 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:16 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-04d35a49-6736-4c3c-82cb-900fd48d86f8 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:16 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-04d35a49-6736-4c3c-82cb-900fd48d86f8 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a" status: 200 len: 1211 microversion: 2.1 time: 0.062961 Apr 12 09:12:16 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 71/213] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:16 2023] GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a => generated 1211 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a3ed65-d508-476d-975d-e8dceb64565a", "tag": "36f04153-f10f-4525-9dd6-35f943897a28"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Creating event network-changed:36f04153-f10f-4525-9dd6-35f943897a28 for instance f4a3ed65-d508-476d-975d-e8dceb64565a on user Apr 12 09:12:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031005 Apr 12 09:12:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 72/214] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a3ed65-d508-476d-975d-e8dceb64565a", "name": "network-vif-plugged", "status": "completed", "tag": "36f04153-f10f-4525-9dd6-35f943897a28"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Creating event network-vif-plugged:36f04153-f10f-4525-9dd6-35f943897a28 for instance f4a3ed65-d508-476d-975d-e8dceb64565a on user Apr 12 09:12:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043283 Apr 12 09:12:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 72/215] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:23 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a3ed65-d508-476d-975d-e8dceb64565a", "name": "network-vif-plugged", "status": "completed", "tag": "36f04153-f10f-4525-9dd6-35f943897a28"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:23 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Creating event network-vif-plugged:36f04153-f10f-4525-9dd6-35f943897a28 for instance f4a3ed65-d508-476d-975d-e8dceb64565a on user Apr 12 09:12:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028854 Apr 12 09:12:23 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 72/216] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:27 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ed45217e-db4d-40ad-8f5b-d46b5e65fd7d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 200 len: 1770 microversion: 2.87 time: 0.160844 Apr 12 09:12:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 73/217] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:12:27 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 1770 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] HTTP exception thrown: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Request method failure captured: Apr 12 09:12:31 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a HTTP/1.1 Apr 12 09:12:31 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:12:31 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:12:31 user devstack@n-api.service[61854]: Connection: close Apr 12 09:12:31 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:12:31 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:12:31 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:12:31 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:12:31 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUdkYfdDqXuY5hOmFKa8_I3n7jK3GcdsrCn79DSXcZKkZIadmkd1yLCuzaeCQRKf4FaPomp-pKeHnvQDks9RVu2gsCriuQmNR1QVyQ1BEtxapB2x023bJrVI3jAZ3vMV0okuDHKLOF81UnP4HoUlm8-FyZVqVavOyYrh2K-F0cCvbs Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Project-Id: c5768be2d4a446f4ac473502a0b909dc Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5768be2d4a446f4ac473502a0b909dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5768be2d4a446f4ac473502a0b909dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5768be2d4a446f4ac473502a0b909dc"}]}] Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Tenant-Id: c5768be2d4a446f4ac473502a0b909dc Apr 12 09:12:31 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:31 user devstack@n-api.service[61854]: X-User: tempest-AttachSCSIVolumeTestJSON-580617659-project-member Apr 12 09:12:31 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:12:31 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:12:31 user devstack@n-api.service[61854]: X-User-Id: 8ac61f1cb87d4ed5a488b2cff4a63375 Apr 12 09:12:31 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-580617659-project-member Apr 12 09:12:31 user devstack@n-api.service[61854]: method: > Apr 12 09:12:31 user devstack@n-api.service[61854]: exception: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:31 user devstack@n-api.service[61854]: action_args: {'id': '22eabe74-0932-472e-8090-09e8431f4f4a'} Apr 12 09:12:31 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Returning 404 to user: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:12:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5e506f64-111b-4b52-84b4-70f54a03cd6c tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a" status: 404 len: 111 microversion: 2.1 time: 0.035189 Apr 12 09:12:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:31 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e8bf23be-2d63-4cee-9b30-6651163bbba8 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '.version_select at 0x7fbd5bbaa3b0>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=14 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e8bf23be-2d63-4cee-9b30-6651163bbba8 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729758921" status: 202 len: 0 microversion: 2.1 time: 0.037642 Apr 12 09:12:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 09:12:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729758921 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0bc73d47-0ee5-4b87-b9a8-01c5bcd5711d tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-instance-actions/req-527aac22-7623-4668-8b9d-b652822fdddc" status: 200 len: 503 microversion: 2.49 time: 0.088026 Apr 12 09:12:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 74/220] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 09:12:31 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-instance-actions/req-527aac22-7623-4668-8b9d-b652822fdddc => generated 503 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-af0dff03-d173-4e89-8ccd-07d509f07612 tempest-TaggedAttachmentsTest-243697218 tempest-TaggedAttachmentsTest-243697218-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-instance-actions/req-527aac22-7623-4668-8b9d-b652822fdddc" status: 200 len: 503 microversion: 2.49 time: 0.044634 Apr 12 09:12:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 74/221] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 09:12:31 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-instance-actions/req-527aac22-7623-4668-8b9d-b652822fdddc => generated 503 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-828b89d8-a28b-442d-ac44-b39465a7fdb1 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.046975 Apr 12 09:12:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 74/222] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 09:12:31 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:12:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 204 len: 0 microversion: 2.49 time: 0.126122 Apr 12 09:12:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 75/223] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:12:31 2023] DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:32 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:32 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-98280210-da44-4a62-aa8b-9a7e40d76f74 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 200 len: 1752 microversion: 2.49 time: 0.231360 Apr 12 09:12:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 75/224] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:12:31 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 1752 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:12:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-unplugged", "status": "completed", "tag": "c7ccda6d-74db-4747-a5eb-dba5e82506fa"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Creating event network-vif-unplugged:c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:12:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037431 Apr 12 09:12:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 75/225] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-deleted", "tag": "c7ccda6d-74db-4747-a5eb-dba5e82506fa"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] Creating event network-vif-deleted:c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:12:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032895 Apr 12 09:12:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbb84fb-1d35-4249-8c8a-d9a02176243c", "name": "network-vif-plugged", "status": "completed", "tag": "c7ccda6d-74db-4747-a5eb-dba5e82506fa"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Creating event network-vif-plugged:c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c on user Apr 12 09:12:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060111 Apr 12 09:12:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 76/227] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] HTTP exception thrown: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Request method failure captured: Apr 12 09:12:34 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a HTTP/1.1 Apr 12 09:12:34 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:12:34 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:12:34 user devstack@n-api.service[61855]: Connection: close Apr 12 09:12:34 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:12:34 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:12:34 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:12:34 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:12:34 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUdkYfdDqXuY5hOmFKa8_I3n7jK3GcdsrCn79DSXcZKkZIadmkd1yLCuzaeCQRKf4FaPomp-pKeHnvQDks9RVu2gsCriuQmNR1QVyQ1BEtxapB2x023bJrVI3jAZ3vMV0okuDHKLOF81UnP4HoUlm8-FyZVqVavOyYrh2K-F0cCvbs Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Project-Id: c5768be2d4a446f4ac473502a0b909dc Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5768be2d4a446f4ac473502a0b909dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5768be2d4a446f4ac473502a0b909dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5768be2d4a446f4ac473502a0b909dc"}]}] Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Tenant-Id: c5768be2d4a446f4ac473502a0b909dc Apr 12 09:12:34 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:34 user devstack@n-api.service[61855]: X-User: tempest-AttachSCSIVolumeTestJSON-580617659-project-member Apr 12 09:12:34 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:12:34 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:12:34 user devstack@n-api.service[61855]: X-User-Id: 8ac61f1cb87d4ed5a488b2cff4a63375 Apr 12 09:12:34 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-580617659-project-member Apr 12 09:12:34 user devstack@n-api.service[61855]: method: > Apr 12 09:12:34 user devstack@n-api.service[61855]: exception: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61855]: action_args: {'id': '22eabe74-0932-472e-8090-09e8431f4f4a'} Apr 12 09:12:34 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Returning 404 to user: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:12:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-108dd9f9-217f-46fb-9bb6-805617d34209 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a" status: 404 len: 111 microversion: 2.1 time: 0.033452 Apr 12 09:12:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:12:34 2023] DELETE /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] HTTP exception thrown: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Request method failure captured: Apr 12 09:12:34 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a HTTP/1.1 Apr 12 09:12:34 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:12:34 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:12:34 user devstack@n-api.service[61853]: Connection: close Apr 12 09:12:34 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:12:34 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:12:34 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:12:34 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:12:34 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUdkYfdDqXuY5hOmFKa8_I3n7jK3GcdsrCn79DSXcZKkZIadmkd1yLCuzaeCQRKf4FaPomp-pKeHnvQDks9RVu2gsCriuQmNR1QVyQ1BEtxapB2x023bJrVI3jAZ3vMV0okuDHKLOF81UnP4HoUlm8-FyZVqVavOyYrh2K-F0cCvbs Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Project-Id: c5768be2d4a446f4ac473502a0b909dc Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5768be2d4a446f4ac473502a0b909dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5768be2d4a446f4ac473502a0b909dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5768be2d4a446f4ac473502a0b909dc"}]}] Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Tenant-Id: c5768be2d4a446f4ac473502a0b909dc Apr 12 09:12:34 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-580617659 Apr 12 09:12:34 user devstack@n-api.service[61853]: X-User: tempest-AttachSCSIVolumeTestJSON-580617659-project-member Apr 12 09:12:34 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:12:34 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:12:34 user devstack@n-api.service[61853]: X-User-Id: 8ac61f1cb87d4ed5a488b2cff4a63375 Apr 12 09:12:34 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-580617659-project-member Apr 12 09:12:34 user devstack@n-api.service[61853]: method: > Apr 12 09:12:34 user devstack@n-api.service[61853]: exception: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61853]: action_args: {'id': '22eabe74-0932-472e-8090-09e8431f4f4a'} Apr 12 09:12:34 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. Apr 12 09:12:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:12:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Returning 404 to user: Instance 22eabe74-0932-472e-8090-09e8431f4f4a could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:12:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-eab9e38b-e9af-45d7-9979-805d824d2fe4 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a" status: 404 len: 111 microversion: 2.1 time: 0.034563 Apr 12 09:12:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 77/229] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:34 2023] GET /compute/v2.1/servers/22eabe74-0932-472e-8090-09e8431f4f4a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2642e6b3-3e25-4e64-aeb8-1c8e3b46d21e tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044721 Apr 12 09:12:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:12:35 2023] GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-03585a27-b392-4f66-aab3-8f9102555f16 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057823 Apr 12 09:12:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 77/231] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:12:35 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:12:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3" status: 204 len: 0 microversion: 2.1 time: 0.130274 Apr 12 09:12:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:12:35 2023] DELETE /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:35 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9257c2223d417298b5927f7b99ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f74eae85c24a72a048bdd03e4d4f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f761f14b-09d9-470b-8c25-ee3584a2e8c6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3" status: 200 len: 1648 microversion: 2.1 time: 0.177339 Apr 12 09:12:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 78/233] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:35 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3 => generated 1648 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f40323-58a6-4e9c-b26b-23615dde13d3", "name": "network-vif-unplugged", "status": "completed", "tag": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Creating event network-vif-unplugged:d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 on user Apr 12 09:12:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075767 Apr 12 09:12:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 78/234] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-670761549"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f40323-58a6-4e9c-b26b-23615dde13d3", "name": "network-vif-plugged", "status": "completed", "tag": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9"}, {"server_uuid": "94f40323-58a6-4e9c-b26b-23615dde13d3", "name": "network-vif-deleted", "tag": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Creating event network-vif-plugged:d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 on user Apr 12 09:12:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Creating event network-vif-deleted:d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 on user Apr 12 09:12:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031708 Apr 12 09:12:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 79/235] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/action" status: 202 len: 0 microversion: 2.1 time: 0.819620 Apr 12 09:12:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 79/236] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:12:37 2023] POST /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/action => generated 0 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:41 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a9aa2d88-c514-43e8-87e7-fc46bdf87bf3 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1655 microversion: 2.1 time: 0.176056 Apr 12 09:12:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 79/237] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:41 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95e901df-9a3a-4145-a12e-c77232853864"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267371 Apr 12 09:12:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 80/238] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:12:41 2023] POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:41 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4e691dc8-766f-4cf2-b2ce-7bf0636eaba3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 200 len: 1504 microversion: 2.1 time: 0.185677 Apr 12 09:12:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 80/239] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:41 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:44 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-46ae447b-e2c0-452f-aa71-82111556a89b tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5bbab490>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:44 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-46ae447b-e2c0-452f-aa71-82111556a89b tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c35effe1-3c15-4b1b-8f41-d1d00993f480" status: 200 len: 350 microversion: 2.1 time: 0.067116 Apr 12 09:12:44 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 80/240] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:12:44 2023] GET /compute/v2.1/os-volumes/c35effe1-3c15-4b1b-8f41-d1d00993f480 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-747cfee9-1949-4456-bc14-cccc84582ac7 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5bd9ad40>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-747cfee9-1949-4456-bc14-cccc84582ac7 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/547ebfbb-9882-4808-9dd2-41b1fbdb50d2" status: 200 len: 350 microversion: 2.1 time: 0.056602 Apr 12 09:12:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 81/241] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:12:46 2023] GET /compute/v2.1/os-volumes/547ebfbb-9882-4808-9dd2-41b1fbdb50d2 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-957660484", "imageRef": "f789b5a9-8687-4ad6-89b8-6ba9685a94d3", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1475014031", "security_groups": [{"name": "tempest-secgroup-smoke-58328323"}], "networks": [{"uuid": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] validate_networks() for [('891ebcc8-f6c9-4839-b624-dd5a9a1a7abd', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting quotas for project 81d39dd859ed4684a659c79ca3ea3fb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting quotas for user e0440debc9af46e690788752e32f0912 and project 81d39dd859ed4684a659c79ca3ea3fb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:12:46 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f789b5a9-8687-4ad6-89b8-6ba9685a94d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:12:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575328 Apr 12 09:12:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 81/242] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:12:46 2023] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:12:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-faf95c9b-eb50-4d40-a724-ba1a800b337c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:46 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-faf95c9b-eb50-4d40-a724-ba1a800b337c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:46 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-faf95c9b-eb50-4d40-a724-ba1a800b337c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-faf95c9b-eb50-4d40-a724-ba1a800b337c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d" status: 200 len: 1236 microversion: 2.1 time: 0.106291 Apr 12 09:12:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 81/243] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:46 2023] GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8375160f-75e8-4e68-ae04-a32d97b93370 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5ba470a0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8375160f-75e8-4e68-ae04-a32d97b93370 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7d4ce5fb-6c71-463e-8ab5-448eaa741f85" status: 200 len: 351 microversion: 2.1 time: 0.059687 Apr 12 09:12:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:12:47 2023] GET /compute/v2.1/os-volumes/7d4ce5fb-6c71-463e-8ab5-448eaa741f85 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7b0acb6a-d57b-483f-9d22-0af296f48938 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5ba2cdc0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7b0acb6a-d57b-483f-9d22-0af296f48938 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.102002 Apr 12 09:12:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 82/245] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 09:12:47 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:47 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7fe62bed-6c12-4327-a03c-9011afe3e8f9 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5bbabeb0>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-7fe62bed-6c12-4327-a03c-9011afe3e8f9 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093995 Apr 12 09:12:47 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 82/246] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 09:12:47 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cca0741c-27ba-483b-b309-49d3523c21db tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5bd9b880>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cca0741c-27ba-483b-b309-49d3523c21db tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091908 Apr 12 09:12:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 83/247] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 09:12:47 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-593b0d16-8352-475a-9662-31e1df216b33 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5bc4b910>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-593b0d16-8352-475a-9662-31e1df216b33 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082929 Apr 12 09:12:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 83/248] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 09:12:47 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7c6c88c8-ac4d-47a7-a997-91fa4a224d03 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5bbe3130>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-7c6c88c8-ac4d-47a7-a997-91fa4a224d03 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083271 Apr 12 09:12:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 83/249] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 09:12:48 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a5dad2ff-dfa7-43a3-9330-8669c2902d4a tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5ba477f0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a5dad2ff-dfa7-43a3-9330-8669c2902d4a tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084401 Apr 12 09:12:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 09:12:48 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a6984751-9bb0-4166-935b-8ef1386a9d13 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5bbabb50>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d227fec7-4eb0-4c73-8293-377293bf1857 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1701 microversion: 2.1 time: 0.165545 Apr 12 09:12:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 84/251] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:48 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1701 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a6984751-9bb0-4166-935b-8ef1386a9d13 tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085133 Apr 12 09:12:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 84/252] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 09:12:48 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-28e7e4f5-ed14-443a-8f84-d7914ed9861b tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] Calling method '.version_select at 0x7fbd5ba479a0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1204181922", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-28e7e4f5-ed14-443a-8f84-d7914ed9861b tempest-VolumesTestJSON-1198403408 tempest-VolumesTestJSON-1198403408-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086579 Apr 12 09:12:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 09:12:48 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for project 20b8c89c46bb460f9f94be9426a22bb8. Resources: dict_keys(['metadata_items']) {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for user 375db5b9a80244d3878822049230ba47 and project 20b8c89c46bb460f9f94be9426a22bb8. Resources: dict_keys(['metadata_items']) {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/action" status: 202 len: 1158 microversion: 2.1 time: 0.342096 Apr 12 09:12:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 85/254] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 09:12:48 2023] POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/action => generated 1158 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:49 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:49 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b24817ee-ac33-49f4-bae9-97c3342eb55e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1730 microversion: 2.1 time: 0.371833 Apr 12 09:12:49 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 85/255] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:48 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1730 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-unplugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Creating event network-vif-unplugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:12:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032475 Apr 12 09:12:49 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Creating event network-changed:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:12:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031442 Apr 12 09:12:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 86/257] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:12:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040379 Apr 12 09:12:51 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 86/258] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:52 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-fed51210-d803-456e-82db-06b2a5dbf8b3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 200 len: 1551 microversion: 2.1 time: 0.161147 Apr 12 09:12:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:52 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Going to try to start instance {{(pid=61853) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 09:12:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action" status: 202 len: 0 microversion: 2.1 time: 0.106103 Apr 12 09:12:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 87/260] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:12:52 2023] POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:52 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:12:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-bdb2aa7e-c82c-43de-a77e-0e1316d5e3ec tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1696 microversion: 2.1 time: 0.164269 Apr 12 09:12:52 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 87/261] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:12:52 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:12:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "name": "network-vif-plugged", "status": "completed", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Creating event network-vif-plugged:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:12:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039670 Apr 12 09:12:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:12:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "name": "network-vif-plugged", "status": "completed", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:12:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:12:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:12:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:12:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Creating event network-vif-plugged:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:12:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058786 Apr 12 09:12:55 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 88/263] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:12:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:00 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:00 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=41 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:13:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054897 Apr 12 09:13:00 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 88/264] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:02 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=23 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:02 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:13:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118791 Apr 12 09:13:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:04 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:04 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:13:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042697 Apr 12 09:13:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 89/266] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:06 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-fc65e07a-5f59-42e6-ad4a-ca29b6bc2b23 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a" status: 200 len: 1495 microversion: 2.1 time: 0.168137 Apr 12 09:13:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 89/267] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:13:06 2023] GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a => generated 1495 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:13:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:13:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038067 Apr 12 09:13:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] HTTP exception thrown: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Request method failure captured: Apr 12 09:13:22 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c HTTP/1.1 Apr 12 09:13:22 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:13:22 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:13:22 user devstack@n-api.service[61853]: Connection: close Apr 12 09:13:22 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:13:22 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:13:22 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:13:22 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:13:22 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUlUuNiNnyg1yuWZG7LjfmCbwTOScqdduiUyr6cHaxeqU6ZQQ23Y4sjNX-EdBCObffdS6ykL3gDAMjxCq0T8skrJSeUqIbUfn9A_dJs_iJT8OiGa-JIdtmgd14sf6Gjp_KnTwR0RoJFoz4TyfE9b5j5uKlCcl0uMtYgVVMuFNAMER8 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Project-Id: ed443186516c4075ab14a4b0be130e31 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Project-Name: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed443186516c4075ab14a4b0be130e31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed443186516c4075ab14a4b0be130e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed443186516c4075ab14a4b0be130e31"}]}] Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Tenant: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Tenant-Id: ed443186516c4075ab14a4b0be130e31 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-User: tempest-TaggedAttachmentsTest-1337552011-project-member Apr 12 09:13:22 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:13:22 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:13:22 user devstack@n-api.service[61853]: X-User-Id: bc97c54107de479bade4014982d79287 Apr 12 09:13:22 user devstack@n-api.service[61853]: X-User-Name: tempest-TaggedAttachmentsTest-1337552011-project-member Apr 12 09:13:22 user devstack@n-api.service[61853]: method: > Apr 12 09:13:22 user devstack@n-api.service[61853]: exception: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:22 user devstack@n-api.service[61853]: action_args: {'id': 'fbbb84fb-1d35-4249-8c8a-d9a02176243c'} Apr 12 09:13:22 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:22 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Returning 404 to user: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:13:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e0006c9c-9d9e-4740-93ed-df361c6b091d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 404 len: 111 microversion: 2.49 time: 0.046244 Apr 12 09:13:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 90/269] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:13:22 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:13:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a9579ef0-3d0c-495e-89a5-c7ab71cd699d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '.version_select at 0x7fbd5bbab0a0>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:22 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:22 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=7 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a9579ef0-3d0c-495e-89a5-c7ab71cd699d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591560650" status: 204 len: 0 microversion: 2.49 time: 0.027289 Apr 12 09:13:22 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 90/270] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 09:13:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591560650 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] HTTP exception thrown: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Request method failure captured: Apr 12 09:13:24 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c HTTP/1.1 Apr 12 09:13:24 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:13:24 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:13:24 user devstack@n-api.service[61854]: Connection: close Apr 12 09:13:24 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:13:24 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:13:24 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:13:24 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:13:24 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUlUuNiNnyg1yuWZG7LjfmCbwTOScqdduiUyr6cHaxeqU6ZQQ23Y4sjNX-EdBCObffdS6ykL3gDAMjxCq0T8skrJSeUqIbUfn9A_dJs_iJT8OiGa-JIdtmgd14sf6Gjp_KnTwR0RoJFoz4TyfE9b5j5uKlCcl0uMtYgVVMuFNAMER8 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Project-Id: ed443186516c4075ab14a4b0be130e31 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Project-Name: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed443186516c4075ab14a4b0be130e31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed443186516c4075ab14a4b0be130e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed443186516c4075ab14a4b0be130e31"}]}] Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Tenant: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Tenant-Id: ed443186516c4075ab14a4b0be130e31 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-User: tempest-TaggedAttachmentsTest-1337552011-project-member Apr 12 09:13:24 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:13:24 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:13:24 user devstack@n-api.service[61854]: X-User-Id: bc97c54107de479bade4014982d79287 Apr 12 09:13:24 user devstack@n-api.service[61854]: X-User-Name: tempest-TaggedAttachmentsTest-1337552011-project-member Apr 12 09:13:24 user devstack@n-api.service[61854]: method: > Apr 12 09:13:24 user devstack@n-api.service[61854]: exception: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61854]: action_args: {'id': 'fbbb84fb-1d35-4249-8c8a-d9a02176243c'} Apr 12 09:13:24 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Returning 404 to user: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:13:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0f38f531-41dc-42c2-877b-0593d3ed32d5 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 404 len: 111 microversion: 2.49 time: 0.043099 Apr 12 09:13:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 91/271] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:13:24 2023] DELETE /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] HTTP exception thrown: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Request method failure captured: Apr 12 09:13:24 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c HTTP/1.1 Apr 12 09:13:24 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:13:24 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:13:24 user devstack@n-api.service[61853]: Connection: close Apr 12 09:13:24 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:13:24 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:13:24 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:13:24 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:13:24 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUlUuNiNnyg1yuWZG7LjfmCbwTOScqdduiUyr6cHaxeqU6ZQQ23Y4sjNX-EdBCObffdS6ykL3gDAMjxCq0T8skrJSeUqIbUfn9A_dJs_iJT8OiGa-JIdtmgd14sf6Gjp_KnTwR0RoJFoz4TyfE9b5j5uKlCcl0uMtYgVVMuFNAMER8 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Project-Id: ed443186516c4075ab14a4b0be130e31 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Project-Name: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed443186516c4075ab14a4b0be130e31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed443186516c4075ab14a4b0be130e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed443186516c4075ab14a4b0be130e31"}]}] Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Tenant: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Tenant-Id: ed443186516c4075ab14a4b0be130e31 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1337552011 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-User: tempest-TaggedAttachmentsTest-1337552011-project-member Apr 12 09:13:24 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:13:24 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:13:24 user devstack@n-api.service[61853]: X-User-Id: bc97c54107de479bade4014982d79287 Apr 12 09:13:24 user devstack@n-api.service[61853]: X-User-Name: tempest-TaggedAttachmentsTest-1337552011-project-member Apr 12 09:13:24 user devstack@n-api.service[61853]: method: > Apr 12 09:13:24 user devstack@n-api.service[61853]: exception: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61853]: action_args: {'id': 'fbbb84fb-1d35-4249-8c8a-d9a02176243c'} Apr 12 09:13:24 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. Apr 12 09:13:24 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:13:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Returning 404 to user: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:13:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4f07a9c4-0a64-4399-b625-99f4d25daf6a tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c" status: 404 len: 111 microversion: 2.49 time: 0.032036 Apr 12 09:13:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 91/272] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:13:24 2023] GET /compute/v2.1/servers/fbbb84fb-1d35-4249-8c8a-d9a02176243c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:25 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] HTTP exception thrown: Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 could not be found. Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Request method failure captured: Apr 12 09:13:25 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3 HTTP/1.1 Apr 12 09:13:25 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:13:25 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:13:25 user devstack@n-api.service[61855]: Connection: close Apr 12 09:13:25 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:13:25 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:13:25 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:13:25 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:13:25 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUZN9gVgyou8dszmMUcytXenpP8eImn8r0vtg3beaen7bNN0NP6kDjAbEy6Y-AbuGSp-lG3fCrzIp7sOpda0xqzZyPp8_WDSOZUuQGFQdjUzlDv1851YNqp6Xk-LjHL1K561sXf44g1C9HI-Dxa2fXv4JG9KwNcR_AxAcz1MTIZvYo Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Project-Id: 70f74eae85c24a72a048bdd03e4d4f19 Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestVolumeSwap-1881322649 Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70f74eae85c24a72a048bdd03e4d4f19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70f74eae85c24a72a048bdd03e4d4f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70f74eae85c24a72a048bdd03e4d4f19"}]}] Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Tenant: tempest-TestVolumeSwap-1881322649 Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Tenant-Id: 70f74eae85c24a72a048bdd03e4d4f19 Apr 12 09:13:25 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestVolumeSwap-1881322649 Apr 12 09:13:25 user devstack@n-api.service[61855]: X-User: tempest-TestVolumeSwap-1881322649-project-member Apr 12 09:13:25 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:13:25 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:13:25 user devstack@n-api.service[61855]: X-User-Id: df9257c2223d417298b5927f7b99ac07 Apr 12 09:13:25 user devstack@n-api.service[61855]: X-User-Name: tempest-TestVolumeSwap-1881322649-project-member Apr 12 09:13:25 user devstack@n-api.service[61855]: method: > Apr 12 09:13:25 user devstack@n-api.service[61855]: exception: Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 could not be found. Apr 12 09:13:25 user devstack@n-api.service[61855]: action_args: {'id': '94f40323-58a6-4e9c-b26b-23615dde13d3'} Apr 12 09:13:25 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 could not be found. Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 could not be found. Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 could not be found. Apr 12 09:13:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:13:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Returning 404 to user: Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:13:25 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-80422f47-0654-4bf3-86d7-49e1ff34ad75 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3" status: 404 len: 111 microversion: 2.1 time: 0.032571 Apr 12 09:13:25 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 91/273] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:13:25 2023] GET /compute/v2.1/servers/94f40323-58a6-4e9c-b26b-23615dde13d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:13:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-398d901c-5073-4f13-b8a7-5b3459d4a1f6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Calling method '.version_select at 0x7fbd5ba46cb0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-398d901c-5073-4f13-b8a7-5b3459d4a1f6 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337351931" status: 202 len: 0 microversion: 2.1 time: 0.038884 Apr 12 09:13:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 92/274] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 09:13:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337351931 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "fa1c2236-9e5d-4388-bbf1-aefd42468884"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:27 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'flavor' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:13:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744/action" status: 200 len: 29 microversion: 2.87 time: 0.545020 Apr 12 09:13:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 92/275] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:13:27 2023] POST /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744/action => generated 29 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:28 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d32edf91-b94b-4cc7-8fa4-e193b6f07f95 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 200 len: 1776 microversion: 2.87 time: 0.313040 Apr 12 09:13:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 92/276] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:13:28 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 1776 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:13:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-unplugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Creating event network-vif-unplugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:13:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040957 Apr 12 09:13:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 93/277] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:13:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031591 Apr 12 09:13:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 93/278] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:33 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:33 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:13:33 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030618 Apr 12 09:13:33 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 93/279] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:13:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175468 Apr 12 09:13:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 94/280] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:37 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-35a2de04-8205-4c40-807c-af2440aea2b7 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d" status: 200 len: 1537 microversion: 2.1 time: 0.483609 Apr 12 09:13:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:13:37 2023] GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d => generated 1537 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:39 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-30750b29-b750-4d0c-8e7b-2207b61bd7ae tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1721 microversion: 2.1 time: 0.359363 Apr 12 09:13:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 94/282] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:13:39 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:43 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:13:43 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5aa6878d-c322-42a5-badf-b3f59e7b4d94 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1700 microversion: 2.1 time: 0.744989 Apr 12 09:13:43 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 95/283] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:13:42 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1700 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:13:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964/action" status: 200 len: 32 microversion: 2.1 time: 0.129712 Apr 12 09:13:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 95/284] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:13:43 2023] POST /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964/action => generated 32 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:43 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:13:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d3ee4e3c-8222-408e-a178-89b3c7512eba tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 200 len: 1510 microversion: 2.1 time: 0.298318 Apr 12 09:13:43 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 95/285] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:13:43 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:13:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-unplugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Creating event network-vif-unplugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:13:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060177 Apr 12 09:13:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 96/286] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:13:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038631 Apr 12 09:13:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 96/287] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:49 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}, {"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:49 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:13:49 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:13:49 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038278 Apr 12 09:13:49 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-31fc2bd5-4e75-4146-8c1b-d7f65859db80 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.362722 Apr 12 09:13:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 97/289] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:13:52 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-interface => generated 283 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:53 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=15 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:53 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Creating event network-changed:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:13:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Apr 12 09:13:53 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 97/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:13:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1968465631"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:13:53 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=25 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:13:55 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/action" status: 202 len: 0 microversion: 2.1 time: 1.076464 Apr 12 09:13:55 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 97/291] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:13:53 2023] POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/action => generated 0 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 09:13:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-79511174-9566-4a15-94af-22882c704794 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '.version_select at 0x7fbd5bba8040>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:13:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-79511174-9566-4a15-94af-22882c704794 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115" status: 200 len: 1611 microversion: 2.1 time: 0.058064 Apr 12 09:13:55 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 09:13:55 2023] GET /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115 => generated 1611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0140443f-d790-4482-a7ad-f89c9b0afa6a tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b9a5fc0>, body: {"keypair": {"name": "tempest-keypair-997992342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:05 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0140443f-d790-4482-a7ad-f89c9b0afa6a tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting quotas for project fa7c759e2e974720a71b31ddbb2adba8. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:14:05 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0140443f-d790-4482-a7ad-f89c9b0afa6a tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting quotas for user 614726429a894b9499267c0c533330b8 and project fa7c759e2e974720a71b31ddbb2adba8. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:14:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0140443f-d790-4482-a7ad-f89c9b0afa6a tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.052709 Apr 12 09:14:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 98/293] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 09:14:05 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 12 09:14:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-957238113", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "49518285-f6aa-449f-ab1b-f86fb262a325"}, {"port": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "tag": "port-1"}, {"port": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "tag": "port-2"}, {"uuid": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "tag": "net-1"}, {"uuid": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f"}, {"uuid": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2ba76717-8078-4e70-8674-985933f03801", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "aebae2e1-26c4-4850-b330-67cd69d5afb6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ce66f1cf-2d13-4309-b3d7-3a48dcd60b20", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1207364265"}], "key_name": "tempest-keypair-997992342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:07 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] validate_networks() for [('49518285-f6aa-449f-ab1b-f86fb262a325', None, None, None, None, None), (None, None, '1de643f2-6b45-4ca5-92ca-057a72e44f63', None, None, None), (None, None, '13cd3fb5-aca8-4a53-ba4e-3e810c35e853', None, None, None), ('ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f', None, None, None, None, None), ('ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f', None, None, None, None, None), ('c98aea99-4504-4ee1-8c0f-1a43ac486ae2', '10.2.2.100', None, None, None, None), ('c98aea99-4504-4ee1-8c0f-1a43ac486ae2', '10.2.2.200', None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "404daba9-5a58-4dd2-9cbf-0f1e288466c4"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=18 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] HTTP exception thrown: Volume d1bfb2b7-2726-46ca-8f2e-6508b75ff51a could not be found. Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Request method failure captured: Apr 12 09:14:07 user devstack@n-api.service[61854]: request: PUT /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a/os-volume_attachments/d1bfb2b7-2726-46ca-8f2e-6508b75ff51a HTTP/1.1 Apr 12 09:14:07 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:14:07 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:14:07 user devstack@n-api.service[61854]: Connection: close Apr 12 09:14:07 user devstack@n-api.service[61854]: Content-Length: 74 Apr 12 09:14:07 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:14:07 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:14:07 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:14:07 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnU2i-hBU3cVR6t9w92oxWL2EOykFt-x2tDrKwSTEYkMqy1pN9pQpycISQT71JK-8Avb7pl-5B5DtI089s1xMLKV1o1HVPdoR33fL9dSjQguWdRx_lGihyw_70YRJ06qK--F-1legvv7ivUvZnYt0cWjBG9-FU8zSC1xZfsd-3pzjOQ Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Project-Id: 46e809df74f24a92bd8caa5887b55a9d Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesAdminNegativeTest-1559680739 Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Role: reader,admin,member Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Roles: reader,admin,member Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46e809df74f24a92bd8caa5887b55a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46e809df74f24a92bd8caa5887b55a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46e809df74f24a92bd8caa5887b55a9d"}]}] Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesAdminNegativeTest-1559680739 Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Tenant-Id: 46e809df74f24a92bd8caa5887b55a9d Apr 12 09:14:07 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1559680739 Apr 12 09:14:07 user devstack@n-api.service[61854]: X-User: tempest-VolumesAdminNegativeTest-1559680739-project-admin Apr 12 09:14:07 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:14:07 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:14:07 user devstack@n-api.service[61854]: X-User-Id: 045d1fd9c7784431a5182a1cf7255268 Apr 12 09:14:07 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesAdminNegativeTest-1559680739-project-admin Apr 12 09:14:07 user devstack@n-api.service[61854]: Apr 12 09:14:07 user devstack@n-api.service[61854]: {"volumeAttachment": {"volumeId": "404daba9-5a58-4dd2-9cbf-0f1e288466c4"}} Apr 12 09:14:07 user devstack@n-api.service[61854]: method: > Apr 12 09:14:07 user devstack@n-api.service[61854]: exception: Volume d1bfb2b7-2726-46ca-8f2e-6508b75ff51a could not be found. Apr 12 09:14:07 user devstack@n-api.service[61854]: action_args: {'server_id': 'f4a3ed65-d508-476d-975d-e8dceb64565a', 'id': 'd1bfb2b7-2726-46ca-8f2e-6508b75ff51a', 'body': {'volumeAttachment': {'volumeId': '404daba9-5a58-4dd2-9cbf-0f1e288466c4'}}} Apr 12 09:14:07 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1bfb2b7-2726-46ca-8f2e-6508b75ff51a could not be found. (HTTP 404) (Request-ID: req-02951209-5f58-4585-8e05-0f20017891bc) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1bfb2b7-2726-46ca-8f2e-6508b75ff51a could not be found. Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1bfb2b7-2726-46ca-8f2e-6508b75ff51a could not be found. Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1bfb2b7-2726-46ca-8f2e-6508b75ff51a could not be found. Apr 12 09:14:07 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:14:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] Returning 404 to user: Volume d1bfb2b7-2726-46ca-8f2e-6508b75ff51a could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:14:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f513583b-24f9-45cf-b737-c7ded767b7e5 tempest-VolumesAdminNegativeTest-1559680739 tempest-VolumesAdminNegativeTest-1559680739-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a/os-volume_attachments/d1bfb2b7-2726-46ca-8f2e-6508b75ff51a" status: 404 len: 109 microversion: 2.1 time: 0.097697 Apr 12 09:14:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 99/294] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 09:14:07 2023] PUT /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a/os-volume_attachments/d1bfb2b7-2726-46ca-8f2e-6508b75ff51a => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting quotas for project fa7c759e2e974720a71b31ddbb2adba8. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting quotas for user 614726429a894b9499267c0c533330b8 and project fa7c759e2e974720a71b31ddbb2adba8. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:14:09 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2ba76717-8078-4e70-8674-985933f03801',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='aebae2e1-26c4-4850-b330-67cd69d5afb6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce66f1cf-2d13-4309-b3d7-3a48dcd60b20',volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:14:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.021637 Apr 12 09:14:09 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 98/295] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 09:14:06 2023] POST /compute/v2.1/servers => generated 404 bytes in 3023 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 12 09:14:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5032d747-bd56-472b-9c88-c7409a33f517 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5032d747-bd56-472b-9c88-c7409a33f517 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5032d747-bd56-472b-9c88-c7409a33f517 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5032d747-bd56-472b-9c88-c7409a33f517 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5032d747-bd56-472b-9c88-c7409a33f517 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5032d747-bd56-472b-9c88-c7409a33f517 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 200 len: 1278 microversion: 2.42 time: 0.086013 Apr 12 09:14:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:14:09 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:14:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a" status: 204 len: 0 microversion: 2.1 time: 0.133530 Apr 12 09:14:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:14:10 2023] DELETE /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:10 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2f5b2c97-56a5-44eb-a75d-da8f4eace1f7 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b9a7910>, body: {"keypair": {"name": "tempest-keypair-302183567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-767bb7b9-aa0c-42c0-8c93-25ddfc0df5be tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a" status: 200 len: 1501 microversion: 2.1 time: 0.184082 Apr 12 09:14:10 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:14:10 2023] GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:10 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-2f5b2c97-56a5-44eb-a75d-da8f4eace1f7 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting quotas for project 5ce13a09e5b842b1997cee5123e0f167. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:14:10 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-2f5b2c97-56a5-44eb-a75d-da8f4eace1f7 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting quotas for user 40052fbebbb4401f89f591ca889b0cfa and project 5ce13a09e5b842b1997cee5123e0f167. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:14:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2f5b2c97-56a5-44eb-a75d-da8f4eace1f7 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.047724 Apr 12 09:14:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 100/299] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 09:14:10 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a3ed65-d508-476d-975d-e8dceb64565a", "name": "network-vif-unplugged", "status": "completed", "tag": "36f04153-f10f-4525-9dd6-35f943897a28"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Creating event network-vif-unplugged:36f04153-f10f-4525-9dd6-35f943897a28 for instance f4a3ed65-d508-476d-975d-e8dceb64565a on user Apr 12 09:14:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097694 Apr 12 09:14:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 101/300] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:12 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-721191578", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b85c5e98-acc1-431c-896a-2f20a3e0387b"}, {"port": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "tag": "port-1"}, {"port": "9f3437a2-863d-44c4-8d16-29e58aadf676", "tag": "port-2"}, {"uuid": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "tag": "net-1"}, {"uuid": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4"}, {"uuid": "772dd9a8-a15b-466c-b344-9bc31830f878", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "772dd9a8-a15b-466c-b344-9bc31830f878", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7d7ff3a5-498a-4f2d-95b7-2a0e77950344", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "91bd6c2d-ef3f-491f-904a-32510538ec83", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "df849839-f09e-44e6-8d36-832c074c558e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--877453534"}], "key_name": "tempest-keypair-302183567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:12 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] validate_networks() for [('b85c5e98-acc1-431c-896a-2f20a3e0387b', None, None, None, None, None), (None, None, '8e85632b-0047-4c19-8d7a-745e21a1bb97', None, None, None), (None, None, '9f3437a2-863d-44c4-8d16-29e58aadf676', None, None, None), ('f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4', None, None, None, None, None), ('f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4', None, None, None, None, None), ('772dd9a8-a15b-466c-b344-9bc31830f878', '10.2.2.100', None, None, None, None), ('772dd9a8-a15b-466c-b344-9bc31830f878', '10.2.2.200', None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:14:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a3ed65-d508-476d-975d-e8dceb64565a", "name": "network-vif-plugged", "status": "completed", "tag": "36f04153-f10f-4525-9dd6-35f943897a28"}, {"server_uuid": "f4a3ed65-d508-476d-975d-e8dceb64565a", "name": "network-vif-deleted", "tag": "36f04153-f10f-4525-9dd6-35f943897a28"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Creating event network-vif-plugged:36f04153-f10f-4525-9dd6-35f943897a28 for instance f4a3ed65-d508-476d-975d-e8dceb64565a on user Apr 12 09:14:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Creating event network-vif-deleted:36f04153-f10f-4525-9dd6-35f943897a28 for instance f4a3ed65-d508-476d-975d-e8dceb64565a on user Apr 12 09:14:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031059 Apr 12 09:14:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 101/301] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting quotas for project 5ce13a09e5b842b1997cee5123e0f167. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting quotas for user 40052fbebbb4401f89f591ca889b0cfa and project 5ce13a09e5b842b1997cee5123e0f167. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:14:14 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7d7ff3a5-498a-4f2d-95b7-2a0e77950344',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='91bd6c2d-ef3f-491f-904a-32510538ec83',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df849839-f09e-44e6-8d36-832c074c558e',volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:14:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 2.549456 Apr 12 09:14:14 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 100/302] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 09:14:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 2551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:14:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2f6fa413-4f48-49dc-89aa-d126158ea027 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2f6fa413-4f48-49dc-89aa-d126158ea027 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:14 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2f6fa413-4f48-49dc-89aa-d126158ea027 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:14 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2f6fa413-4f48-49dc-89aa-d126158ea027 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:14 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2f6fa413-4f48-49dc-89aa-d126158ea027 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2f6fa413-4f48-49dc-89aa-d126158ea027 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 200 len: 1278 microversion: 2.32 time: 0.082070 Apr 12 09:14:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 102/303] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:14:14 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:14:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "8403a9c1-5cfb-4f4a-bace-89f6a6130872"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Creating event network-changed:8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031236 Apr 12 09:14:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 102/304] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:18 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "1de643f2-6b45-4ca5-92ca-057a72e44f63"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:18 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Creating event network-changed:1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:18 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032292 Apr 12 09:14:18 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 101/305] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2a976c3b-086b-44e5-b224-1205a461f05d tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 200 len: 1756 microversion: 2.87 time: 0.340755 Apr 12 09:14:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 103/306] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:14:18 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 1756 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:14:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Creating event network-changed:13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033268 Apr 12 09:14:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 103/307] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:14:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "d221807b-9715-4917-99a5-eecefd100946"}, {"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "422290f4-824f-41ca-9a75-8031d21416a5"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Creating event network-changed:d221807b-9715-4917-99a5-eecefd100946 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Creating event network-changed:422290f4-824f-41ca-9a75-8031d21416a5 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039139 Apr 12 09:14:22 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 102/308] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:22 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "69ed460b-cbfb-4ab2-9008-58b16a554e4a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Creating event network-changed:69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174676 Apr 12 09:14:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 104/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "80680073-3437-4be0-bf87-9ab62eb1320a"}, {"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Creating event network-changed:80680073-3437-4be0-bf87-9ab62eb1320a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Creating event network-changed:01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042593 Apr 12 09:14:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=12 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "8e85632b-0047-4c19-8d7a-745e21a1bb97"}, {"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "9f3437a2-863d-44c4-8d16-29e58aadf676"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Creating event network-changed:8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Creating event network-changed:9f3437a2-863d-44c4-8d16-29e58aadf676 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037481 Apr 12 09:14:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 103/311] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:30 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "0a6649c3-bb81-4507-8666-3d78390b0579"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Creating event network-changed:0a6649c3-bb81-4507-8666-3d78390b0579 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039297 Apr 12 09:14:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 105/312] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd"}, {"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "f4d0c163-2589-499a-8da8-68891a344baf"}, {"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "be9408ea-445a-400a-a479-2c948b0e2a90"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Creating event network-changed:ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Creating event network-changed:f4d0c163-2589-499a-8da8-68891a344baf for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Creating event network-changed:be9408ea-445a-400a-a479-2c948b0e2a90 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.029519 Apr 12 09:14:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:32 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:34 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d9df2ebb-15cb-4dea-8534-f8bd562882cd tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 200 len: 1490 microversion: 2.1 time: 0.262321 Apr 12 09:14:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 104/314] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:14:33 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 1490 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "8403a9c1-5cfb-4f4a-bace-89f6a6130872"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Creating event network-vif-plugged:8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036924 Apr 12 09:14:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 106/315] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "1de643f2-6b45-4ca5-92ca-057a72e44f63"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Creating event network-vif-plugged:1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137241 Apr 12 09:14:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 106/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "422290f4-824f-41ca-9a75-8031d21416a5"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:37 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:37 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=23 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Creating event network-vif-plugged:422290f4-824f-41ca-9a75-8031d21416a5 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094806 Apr 12 09:14:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 105/317] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-da9333b6-90d1-4b54-a511-379b590f03f3 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d" status: 200 len: 1537 microversion: 2.1 time: 0.341593 Apr 12 09:14:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 107/318] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:14:37 2023] GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d => generated 1537 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "8403a9c1-5cfb-4f4a-bace-89f6a6130872"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "69ed460b-cbfb-4ab2-9008-58b16a554e4a"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "69ed460b-cbfb-4ab2-9008-58b16a554e4a"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Creating event network-vif-plugged:8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Creating event network-vif-plugged:13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Creating event network-vif-plugged:13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Creating event network-vif-plugged:69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Creating event network-vif-plugged:69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034982 Apr 12 09:14:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 107/319] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:38 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "1de643f2-6b45-4ca5-92ca-057a72e44f63"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "d221807b-9715-4917-99a5-eecefd100946"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "d221807b-9715-4917-99a5-eecefd100946"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Creating event network-vif-plugged:1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Creating event network-vif-plugged:d221807b-9715-4917-99a5-eecefd100946 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Creating event network-vif-plugged:d221807b-9715-4917-99a5-eecefd100946 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046351 Apr 12 09:14:38 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 106/320] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "422290f4-824f-41ca-9a75-8031d21416a5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Creating event network-vif-plugged:422290f4-824f-41ca-9a75-8031d21416a5 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039188 Apr 12 09:14:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "236d694a-0b00-4b38-8770-54a0485d8b56"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:39 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8af2d742-3671-4bd7-a204-af77c126604c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1721 microversion: 2.1 time: 0.302168 Apr 12 09:14:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 108/322] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:14:39 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300818 Apr 12 09:14:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 107/323] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:14:39 2023] POST /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:40 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ceafd829-e626-4879-8270-f11c1a4f6a7c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1721 microversion: 2.1 time: 0.161074 Apr 12 09:14:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:14:40 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "80680073-3437-4be0-bf87-9ab62eb1320a"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "80680073-3437-4be0-bf87-9ab62eb1320a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Creating event network-vif-plugged:80680073-3437-4be0-bf87-9ab62eb1320a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Creating event network-vif-plugged:80680073-3437-4be0-bf87-9ab62eb1320a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:14:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047712 Apr 12 09:14:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 109/325] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Creating event network-changed:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:14:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043581 Apr 12 09:14:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 108/326] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "8e85632b-0047-4c19-8d7a-745e21a1bb97"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Creating event network-vif-plugged:8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038503 Apr 12 09:14:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Creating event network-vif-plugged:01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Creating event network-vif-plugged:01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038635 Apr 12 09:14:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 110/328] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:42 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "0a6649c3-bb81-4507-8666-3d78390b0579"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Creating event network-vif-plugged:0a6649c3-bb81-4507-8666-3d78390b0579 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058976 Apr 12 09:14:42 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 109/329] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:44 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'services' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:14:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-volume_attachments/a058b665-da02-444b-8e77-862141ce3a61" status: 202 len: 0 microversion: 2.1 time: 0.423745 Apr 12 09:14:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:14:43 2023] DELETE /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-volume_attachments/a058b665-da02-444b-8e77-862141ce3a61 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:14:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "8e85632b-0047-4c19-8d7a-745e21a1bb97"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "9f3437a2-863d-44c4-8d16-29e58aadf676"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "9f3437a2-863d-44c4-8d16-29e58aadf676"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "f4d0c163-2589-499a-8da8-68891a344baf"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "f4d0c163-2589-499a-8da8-68891a344baf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Creating event network-vif-plugged:8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Creating event network-vif-plugged:9f3437a2-863d-44c4-8d16-29e58aadf676 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Creating event network-vif-plugged:9f3437a2-863d-44c4-8d16-29e58aadf676 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Creating event network-vif-plugged:f4d0c163-2589-499a-8da8-68891a344baf for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Creating event network-vif-plugged:f4d0c163-2589-499a-8da8-68891a344baf for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "be9408ea-445a-400a-a479-2c948b0e2a90"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "be9408ea-445a-400a-a479-2c948b0e2a90"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.053147 Apr 12 09:14:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:44 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Creating event network-vif-plugged:be9408ea-445a-400a-a479-2c948b0e2a90 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Creating event network-vif-plugged:be9408ea-445a-400a-a479-2c948b0e2a90 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056755 Apr 12 09:14:44 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 110/332] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "0a6649c3-bb81-4507-8666-3d78390b0579"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Creating event network-vif-plugged:0a6649c3-bb81-4507-8666-3d78390b0579 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Creating event network-vif-plugged:ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Creating event network-vif-plugged:ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:14:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033194 Apr 12 09:14:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 112/333] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5ab1b782-75cf-437f-8da2-daea0b35b871 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '.version_select at 0x7fbd5be65e10>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5ab1b782-75cf-437f-8da2-daea0b35b871 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115" status: 200 len: 1725 microversion: 2.1 time: 0.083088 Apr 12 09:14:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 09:14:45 2023] GET /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115 => generated 1725 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:45 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-63dba31d-b5c0-4ca7-88b3-0497ecde38fe tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '.version_select at 0x7fbd5bbe0b80>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-63dba31d-b5c0-4ca7-88b3-0497ecde38fe tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115" status: 200 len: 1725 microversion: 2.1 time: 0.075295 Apr 12 09:14:45 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 09:14:45 2023] GET /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115 => generated 1725 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:45 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-46d851d4-ee1c-4f92-99c3-1751997b72c3 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 200 len: 1669 microversion: 2.1 time: 0.209768 Apr 12 09:14:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 113/336] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:14:45 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:46 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Going to try to stop instance {{(pid=61854) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 09:14:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action" status: 202 len: 0 microversion: 2.1 time: 0.222074 Apr 12 09:14:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 113/337] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:14:46 2023] POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:46 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:14:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-3064be96-637f-4467-9cd4-83f063471040 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1664 microversion: 2.1 time: 0.163838 Apr 12 09:14:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:14:46 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:14:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-unplugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Creating event network-vif-unplugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:14:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057920 Apr 12 09:14:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 114/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:48 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'services' on Instance uuid 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:14:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments/236d694a-0b00-4b38-8770-54a0485d8b56" status: 202 len: 0 microversion: 2.1 time: 0.179783 Apr 12 09:14:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:14:48 2023] DELETE /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments/236d694a-0b00-4b38-8770-54a0485d8b56 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-8b029ceb-24a4-492c-a4e8-3d6f33a88dd6 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064641 Apr 12 09:14:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:14:48 2023] GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:14:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:14:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:14:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:14:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:14:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:14:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034080 Apr 12 09:14:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:14:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=11 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c76c5730-e581-4621-bc3e-68f4f10e1bbb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 200 len: 2828 microversion: 2.42 time: 0.220081 Apr 12 09:15:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 115/343] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:15:00 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 2828 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=15 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] HTTP exception thrown: Instance f4a3ed65-d508-476d-975d-e8dceb64565a could not be found. Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Request method failure captured: Apr 12 09:15:00 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a HTTP/1.1 Apr 12 09:15:00 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:15:00 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:15:00 user devstack@n-api.service[61855]: Connection: close Apr 12 09:15:00 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:15:00 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:15:00 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:15:00 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:15:00 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUe9eiFoU8TthBLS-hYX4s-Gpr5PMgm2NxYNrvHc3M7zQ962kmGT-cQVCtOaWjD855dh6l52ul8q7YEgf0-DbTHwTwUzJ8cqckht6NsutWIvI0MCWBA-2ymMIZ_q-iYhrXPiU3fmi6rcnhOp9M1h4O8ZrYeGxR9XUCX_FVb2dy4mo8 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Project-Id: dd9e7d6ece244a96b01277451a3ed5a5 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Project-Name: tempest-VolumesAdminNegativeTest-588655718 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dd9e7d6ece244a96b01277451a3ed5a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dd9e7d6ece244a96b01277451a3ed5a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dd9e7d6ece244a96b01277451a3ed5a5"}]}] Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Tenant: tempest-VolumesAdminNegativeTest-588655718 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Tenant-Id: dd9e7d6ece244a96b01277451a3ed5a5 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-588655718 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-User: tempest-VolumesAdminNegativeTest-588655718-project-member Apr 12 09:15:00 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:15:00 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:15:00 user devstack@n-api.service[61855]: X-User-Id: 8911ec7c959541989cce3870ba11fb80 Apr 12 09:15:00 user devstack@n-api.service[61855]: X-User-Name: tempest-VolumesAdminNegativeTest-588655718-project-member Apr 12 09:15:00 user devstack@n-api.service[61855]: method: > Apr 12 09:15:00 user devstack@n-api.service[61855]: exception: Instance f4a3ed65-d508-476d-975d-e8dceb64565a could not be found. Apr 12 09:15:00 user devstack@n-api.service[61855]: action_args: {'id': 'f4a3ed65-d508-476d-975d-e8dceb64565a'} Apr 12 09:15:00 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a3ed65-d508-476d-975d-e8dceb64565a could not be found. Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a3ed65-d508-476d-975d-e8dceb64565a could not be found. Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a3ed65-d508-476d-975d-e8dceb64565a could not be found. Apr 12 09:15:00 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:15:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Returning 404 to user: Instance f4a3ed65-d508-476d-975d-e8dceb64565a could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:15:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b6a1b970-6bb9-44b7-a86c-a88d3e0a2f1d tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a" status: 404 len: 111 microversion: 2.1 time: 0.035448 Apr 12 09:15:00 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 114/344] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:00 2023] GET /compute/v2.1/servers/f4a3ed65-d508-476d-975d-e8dceb64565a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=19 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:15:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035" status: 204 len: 0 microversion: 2.1 time: 0.158856 Apr 12 09:15:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 116/345] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:15:02 2023] DELETE /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-233f9cfd-7bc1-49b3-8afe-ce5c69c4b3b3 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035" status: 200 len: 1670 microversion: 2.1 time: 0.173918 Apr 12 09:15:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:03 2023] GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:15:03 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0bc5da-ed98-417a-9fc1-1f636887f035", "name": "network-vif-unplugged", "status": "completed", "tag": "473a9253-5ee7-4ef1-bd1a-f260bc80b158"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:03 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Creating event network-vif-unplugged:473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 on user Apr 12 09:15:03 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030148 Apr 12 09:15:03 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:05 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:05 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:05 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b95195c8-e147-478d-a521-4a1b12fd2be2 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 200 len: 2819 microversion: 2.32 time: 0.237479 Apr 12 09:15:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 117/348] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:15:04 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 2819 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:15:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0bc5da-ed98-417a-9fc1-1f636887f035", "name": "network-vif-plugged", "status": "completed", "tag": "473a9253-5ee7-4ef1-bd1a-f260bc80b158"}, {"server_uuid": "1d0bc5da-ed98-417a-9fc1-1f636887f035", "name": "network-vif-deleted", "tag": "473a9253-5ee7-4ef1-bd1a-f260bc80b158"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Creating event network-vif-plugged:473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 on user Apr 12 09:15:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Creating event network-vif-deleted:473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 on user Apr 12 09:15:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033034 Apr 12 09:15:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 117/349] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744/action" status: 202 len: 0 microversion: 2.87 time: 0.081135 Apr 12 09:15:19 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 116/350] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:15:19 2023] POST /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:19 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8c6c7915-c073-4a45-bcc2-6368904f9f09 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 200 len: 1764 microversion: 2.87 time: 0.165437 Apr 12 09:15:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 118/351] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:15:19 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 1764 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:15:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-unplugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Creating event network-vif-unplugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:15:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045685 Apr 12 09:15:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:21 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}, {"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:15:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:15:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029748 Apr 12 09:15:21 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:15:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Apr 12 09:15:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 119/354] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aca741a-6840-4026-8ed9-b8d3b5c32b7c"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 4a835849-83a7-457d-a96d-0acaa5a4a964 while it is in vm_state rescued Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Request method failure captured: Apr 12 09:15:34 user devstack@n-api.service[61854]: request: POST /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964/os-volume_attachments HTTP/1.1 Apr 12 09:15:34 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:15:34 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:15:34 user devstack@n-api.service[61854]: Connection: close Apr 12 09:15:34 user devstack@n-api.service[61854]: Content-Length: 74 Apr 12 09:15:34 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:15:34 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:15:34 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:15:34 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUmzpnT2cMNRisqprbMBjK9A1uBhsL4RIBULwrcb8xUYU3J1ossx8P92asSGNh52uNaEWAWU55CzY2DJliTlktGcPrAcsk2XEdOBkdHmCo1sz_NMega_JCagABoco4-yxoKPVnTz99TSp4tFLRyNDP0z2nJkU4iIAwfrhrvWynyp-Q Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Project-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}] Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Tenant-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:15:34 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:15:34 user devstack@n-api.service[61854]: X-User: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:15:34 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:15:34 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:15:34 user devstack@n-api.service[61854]: X-User-Id: 7f6b983634234693ba04a3097c2a129b Apr 12 09:15:34 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:15:34 user devstack@n-api.service[61854]: Apr 12 09:15:34 user devstack@n-api.service[61854]: {"volumeAttachment": {"volumeId": "9aca741a-6840-4026-8ed9-b8d3b5c32b7c"}} Apr 12 09:15:34 user devstack@n-api.service[61854]: method: > Apr 12 09:15:34 user devstack@n-api.service[61854]: exception: Cannot 'attach_volume' instance 4a835849-83a7-457d-a96d-0acaa5a4a964 while it is in vm_state rescued Apr 12 09:15:34 user devstack@n-api.service[61854]: action_args: {'server_id': '4a835849-83a7-457d-a96d-0acaa5a4a964', 'body': {'volumeAttachment': {'volumeId': '9aca741a-6840-4026-8ed9-b8d3b5c32b7c'}}} Apr 12 09:15:34 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4a835849-83a7-457d-a96d-0acaa5a4a964 while it is in vm_state rescued Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4a835849-83a7-457d-a96d-0acaa5a4a964 while it is in vm_state rescued Apr 12 09:15:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Returning 409 to user: Cannot 'attach_volume' instance 4a835849-83a7-457d-a96d-0acaa5a4a964 while it is in vm_state rescued {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:15:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-02b89ea6-817a-4bce-920c-75b8857ea9b6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049520 Apr 12 09:15:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:15:34 2023] POST /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964/action" status: 202 len: 0 microversion: 2.1 time: 0.075194 Apr 12 09:15:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 118/356] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:15:34 2023] POST /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:34 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-32b22ee6-8cff-4d42-a639-9cd7306e3500 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 200 len: 1498 microversion: 2.1 time: 0.162986 Apr 12 09:15:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:34 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:15:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-unplugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Creating event network-vif-unplugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:15:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033630 Apr 12 09:15:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:37 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-75dd2eac-333d-4244-a995-e0bd544f2899 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1641 microversion: 2.1 time: 0.159724 Apr 12 09:15:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:36 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1641 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:15:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}, {"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:15:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:15:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030401 Apr 12 09:15:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 121/360] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e5f2ca86-8a98-4e86-aeb8-c54739b977ca tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050724 Apr 12 09:15:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:15:38 2023] GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Creating event network-changed:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:15:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031572 Apr 12 09:15:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 122/362] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:15:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:15:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040770 Apr 12 09:15:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d" status: 204 len: 0 microversion: 2.1 time: 0.156446 Apr 12 09:15:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 120/364] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:15:39 2023] DELETE /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:39 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-df30770c-760d-4023-9144-4eaa515035a1 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d" status: 200 len: 1662 microversion: 2.1 time: 0.191983 Apr 12 09:15:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 123/365] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:39 2023] GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d => generated 1662 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:40 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'services' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:15:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments/95e901df-9a3a-4145-a12e-c77232853864" status: 202 len: 0 microversion: 2.1 time: 0.201919 Apr 12 09:15:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:15:40 2023] DELETE /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments/95e901df-9a3a-4145-a12e-c77232853864 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-bc221928-df9b-480d-a778-80c798a4a1c0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048475 Apr 12 09:15:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 121/367] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:15:40 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-13f8bc87-981c-4aa4-a33a-db2fbd730a34 req-37dd1214-bedb-401f-abc3-a268c3287eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "name": "network-vif-deleted", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-13f8bc87-981c-4aa4-a33a-db2fbd730a34 req-37dd1214-bedb-401f-abc3-a268c3287eb0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-13f8bc87-981c-4aa4-a33a-db2fbd730a34 req-37dd1214-bedb-401f-abc3-a268c3287eb0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-13f8bc87-981c-4aa4-a33a-db2fbd730a34 req-37dd1214-bedb-401f-abc3-a268c3287eb0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-13f8bc87-981c-4aa4-a33a-db2fbd730a34 req-37dd1214-bedb-401f-abc3-a268c3287eb0 service nova] Creating event network-vif-deleted:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:15:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-13f8bc87-981c-4aa4-a33a-db2fbd730a34 req-37dd1214-bedb-401f-abc3-a268c3287eb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031591 Apr 12 09:15:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 124/368] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "name": "network-vif-unplugged", "status": "completed", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}, {"server_uuid": "3872dcd7-8f2e-4b6e-9450-f8939143a94d", "name": "network-vif-plugged", "status": "completed", "tag": "cbba3d0e-337f-4f59-90b6-6216192cdb3b"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Creating event network-vif-unplugged:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:15:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Creating event network-vif-plugged:cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d on user Apr 12 09:15:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035074 Apr 12 09:15:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 124/369] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:46 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-1fd75672-16bc-4a4d-83cc-ce9d173f52f6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 200 len: 1669 microversion: 2.1 time: 0.156877 Apr 12 09:15:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 122/370] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:45 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524097 Apr 12 09:15:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 125/371] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:15:48 2023] POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] HTTP exception thrown: Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 could not be found. Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Request method failure captured: Apr 12 09:15:53 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035 HTTP/1.1 Apr 12 09:15:53 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:15:53 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:15:53 user devstack@n-api.service[61854]: Connection: close Apr 12 09:15:53 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:15:53 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:15:53 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:15:53 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:15:53 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUe9eiFoU8TthBLS-hYX4s-Gpr5PMgm2NxYNrvHc3M7zQ962kmGT-cQVCtOaWjD855dh6l52ul8q7YEgf0-DbTHwTwUzJ8cqckht6NsutWIvI0MCWBA-2ymMIZ_q-iYhrXPiU3fmi6rcnhOp9M1h4O8ZrYeGxR9XUCX_FVb2dy4mo8 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Project-Id: dd9e7d6ece244a96b01277451a3ed5a5 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesAdminNegativeTest-588655718 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dd9e7d6ece244a96b01277451a3ed5a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dd9e7d6ece244a96b01277451a3ed5a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dd9e7d6ece244a96b01277451a3ed5a5"}]}] Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesAdminNegativeTest-588655718 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Tenant-Id: dd9e7d6ece244a96b01277451a3ed5a5 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-588655718 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-User: tempest-VolumesAdminNegativeTest-588655718-project-member Apr 12 09:15:53 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:15:53 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:15:53 user devstack@n-api.service[61854]: X-User-Id: 8911ec7c959541989cce3870ba11fb80 Apr 12 09:15:53 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesAdminNegativeTest-588655718-project-member Apr 12 09:15:53 user devstack@n-api.service[61854]: method: > Apr 12 09:15:53 user devstack@n-api.service[61854]: exception: Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 could not be found. Apr 12 09:15:53 user devstack@n-api.service[61854]: action_args: {'id': '1d0bc5da-ed98-417a-9fc1-1f636887f035'} Apr 12 09:15:53 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 could not be found. Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 could not be found. Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 could not be found. Apr 12 09:15:53 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:15:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Returning 404 to user: Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:15:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3e3be7b1-b544-42cb-a8b8-b6a0d6598bc0 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035" status: 404 len: 111 microversion: 2.1 time: 0.035933 Apr 12 09:15:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:53 2023] GET /compute/v2.1/servers/1d0bc5da-ed98-417a-9fc1-1f636887f035 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:15:53 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-166fbe06-265b-460b-a16e-f244eb602b87 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Calling method '.version_select at 0x7fbd5bbe3880>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:53 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-166fbe06-265b-460b-a16e-f244eb602b87 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521589223" status: 202 len: 0 microversion: 2.1 time: 0.022637 Apr 12 09:15:53 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 123/373] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 09:15:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521589223 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "86dc6d0f-1950-42bf-bc62-aaa37f02c115"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:56 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'flavor' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:15:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/action" status: 200 len: 29 microversion: 2.1 time: 0.205325 Apr 12 09:15:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 126/374] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:15:56 2023] POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/action => generated 29 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:56 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:15:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b63e49d2-3d7d-437b-a335-252bb5567f49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 200 len: 1721 microversion: 2.1 time: 0.148165 Apr 12 09:15:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:15:56 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:15:57 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:15:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-unplugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:15:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:15:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:15:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:15:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Creating event network-vif-unplugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:15:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036650 Apr 12 09:15:58 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 124/376] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:15:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:16:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029782 Apr 12 09:16:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 127/377] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1f01aadf-d106-4328-8828-f1a43daa7347 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.167930 Apr 12 09:16:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 127/378] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 09:16:00 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/os-interface => generated 1829 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "tag": "8403a9c1-5cfb-4f4a-bace-89f6a6130872"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Creating event network-changed:8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038706 Apr 12 09:16:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 125/379] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:01 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5190e87d-3a2d-42c8-8c82-97a0d936c530 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 200 len: 2828 microversion: 2.42 time: 0.203239 Apr 12 09:16:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 128/380] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:01 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 2828 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d997cd88-4fcd-43d0-8de3-f64607700e74 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.115277 Apr 12 09:16:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 128/381] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 09:16:01 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/os-interface => generated 1829 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:02 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:16:02 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037181 Apr 12 09:16:02 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 126/382] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:16:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 204 len: 0 microversion: 2.42 time: 0.121895 Apr 12 09:16:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 129/383] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:16:02 2023] DELETE /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e55e79cb-ce1e-44ec-89fe-33d6018a5b14 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 200 len: 2953 microversion: 2.42 time: 0.294560 Apr 12 09:16:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 129/384] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:03 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 2953 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:03 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-unplugged", "status": "completed", "tag": "1de643f2-6b45-4ca5-92ca-057a72e44f63"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:03 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Creating event network-vif-unplugged:1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:03 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035746 Apr 12 09:16:03 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 127/385] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-unplugged", "status": "completed", "tag": "422290f4-824f-41ca-9a75-8031d21416a5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Creating event network-vif-unplugged:422290f4-824f-41ca-9a75-8031d21416a5 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041790 Apr 12 09:16:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 130/386] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-unplugged", "status": "completed", "tag": "8403a9c1-5cfb-4f4a-bace-89f6a6130872"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "8403a9c1-5cfb-4f4a-bace-89f6a6130872"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-unplugged", "status": "completed", "tag": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:16:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Creating event network-vif-unplugged:8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Creating event network-vif-plugged:8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Creating event network-vif-unplugged:13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Creating event network-vif-plugged:13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.053859 Apr 12 09:16:04 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 130/387] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:05 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b58278e1-5692-4922-9e89-b60bbecc6d13 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.131049 Apr 12 09:16:05 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 128/388] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 09:16:05 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa/os-interface => generated 1829 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "1de643f2-6b45-4ca5-92ca-057a72e44f63"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-unplugged", "status": "completed", "tag": "d221807b-9715-4917-99a5-eecefd100946"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "d221807b-9715-4917-99a5-eecefd100946"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Creating event network-vif-plugged:1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Creating event network-vif-unplugged:d221807b-9715-4917-99a5-eecefd100946 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Creating event network-vif-plugged:d221807b-9715-4917-99a5-eecefd100946 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042528 Apr 12 09:16:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 131/389] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:05 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "422290f4-824f-41ca-9a75-8031d21416a5"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Creating event network-vif-plugged:422290f4-824f-41ca-9a75-8031d21416a5 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072706 Apr 12 09:16:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 131/390] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-unplugged", "status": "completed", "tag": "69ed460b-cbfb-4ab2-9008-58b16a554e4a"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "69ed460b-cbfb-4ab2-9008-58b16a554e4a"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-unplugged", "status": "completed", "tag": "80680073-3437-4be0-bf87-9ab62eb1320a"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-plugged", "status": "completed", "tag": "80680073-3437-4be0-bf87-9ab62eb1320a"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Creating event network-vif-unplugged:69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Creating event network-vif-plugged:69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Creating event network-vif-unplugged:80680073-3437-4be0-bf87-9ab62eb1320a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Creating event network-vif-plugged:80680073-3437-4be0-bf87-9ab62eb1320a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.053707 Apr 12 09:16:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 132/391] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:06 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-88a072a9-b675-4651-924f-2964f8641918 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 200 len: 2819 microversion: 2.32 time: 0.270437 Apr 12 09:16:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 129/392] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:06 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 2819 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f390262a-ea02-4d4c-9e8e-fed578be67cd tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.134216 Apr 12 09:16:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 132/393] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 09:16:06 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa/os-interface => generated 1829 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "tag": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Creating event network-changed:01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034664 Apr 12 09:16:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 133/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:07 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:16:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 204 len: 0 microversion: 2.32 time: 0.130574 Apr 12 09:16:08 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 130/395] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:16:07 2023] DELETE /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a9e694b6-c6e2-46d6-b762-cd690e6e8080 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 200 len: 2825 microversion: 2.32 time: 0.349928 Apr 12 09:16:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 133/396] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:08 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 2825 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-unplugged", "status": "completed", "tag": "8e85632b-0047-4c19-8d7a-745e21a1bb97"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Creating event network-vif-unplugged:8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056631 Apr 12 09:16:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 134/397] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:08 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-unplugged", "status": "completed", "tag": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Creating event network-vif-unplugged:01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088090 Apr 12 09:16:08 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 131/398] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6cdf4af5-abdd-4b28-bc2f-5a9e80f66b32 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 200 len: 1770 microversion: 2.87 time: 0.276870 Apr 12 09:16:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 134/399] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:09 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 1770 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:16:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-unplugged", "status": "completed", "tag": "0a6649c3-bb81-4507-8666-3d78390b0579"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "0a6649c3-bb81-4507-8666-3d78390b0579"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-unplugged", "status": "completed", "tag": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Creating event network-vif-unplugged:0a6649c3-bb81-4507-8666-3d78390b0579 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Creating event network-vif-plugged:0a6649c3-bb81-4507-8666-3d78390b0579 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Creating event network-vif-unplugged:ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Creating event network-vif-plugged:ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.057128 Apr 12 09:16:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:09 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:10 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "8e85632b-0047-4c19-8d7a-745e21a1bb97"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-unplugged", "status": "completed", "tag": "9f3437a2-863d-44c4-8d16-29e58aadf676"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "9f3437a2-863d-44c4-8d16-29e58aadf676"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-unplugged", "status": "completed", "tag": "f4d0c163-2589-499a-8da8-68891a344baf"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "f4d0c163-2589-499a-8da8-68891a344baf"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Creating event network-vif-plugged:8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Creating event network-vif-unplugged:9f3437a2-863d-44c4-8d16-29e58aadf676 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Creating event network-vif-plugged:9f3437a2-863d-44c4-8d16-29e58aadf676 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Creating event network-vif-unplugged:f4d0c163-2589-499a-8da8-68891a344baf for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Creating event network-vif-plugged:f4d0c163-2589-499a-8da8-68891a344baf for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.044808 Apr 12 09:16:10 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 132/401] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:10 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-deleted", "tag": "69ed460b-cbfb-4ab2-9008-58b16a554e4a"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-unplugged", "status": "completed", "tag": "be9408ea-445a-400a-a479-2c948b0e2a90"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-plugged", "status": "completed", "tag": "be9408ea-445a-400a-a479-2c948b0e2a90"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-deleted", "tag": "8403a9c1-5cfb-4f4a-bace-89f6a6130872"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Creating event network-vif-plugged:01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Creating event network-vif-deleted:69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Creating event network-vif-unplugged:be9408ea-445a-400a-a479-2c948b0e2a90 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Creating event network-vif-plugged:be9408ea-445a-400a-a479-2c948b0e2a90 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Creating event network-vif-deleted:8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.040304 Apr 12 09:16:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 135/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:11 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-deleted", "tag": "80680073-3437-4be0-bf87-9ab62eb1320a"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-deleted", "tag": "d221807b-9715-4917-99a5-eecefd100946"}, {"server_uuid": "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c", "name": "network-vif-deleted", "tag": "422290f4-824f-41ca-9a75-8031d21416a5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] Creating event network-vif-deleted:80680073-3437-4be0-bf87-9ab62eb1320a for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] Creating event network-vif-deleted:d221807b-9715-4917-99a5-eecefd100946 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] Creating event network-vif-deleted:422290f4-824f-41ca-9a75-8031d21416a5 for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c on user Apr 12 09:16:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035135 Apr 12 09:16:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 136/403] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:13 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-deleted", "tag": "be9408ea-445a-400a-a479-2c948b0e2a90"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-deleted", "tag": "0a6649c3-bb81-4507-8666-3d78390b0579"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-deleted", "tag": "f4d0c163-2589-499a-8da8-68891a344baf"}, {"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-deleted", "tag": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Creating event network-vif-deleted:be9408ea-445a-400a-a479-2c948b0e2a90 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Creating event network-vif-deleted:0a6649c3-bb81-4507-8666-3d78390b0579 for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Creating event network-vif-deleted:f4d0c163-2589-499a-8da8-68891a344baf for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] Creating event network-vif-deleted:ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.057034 Apr 12 09:16:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 133/404] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cc045452-ddf8-49e7-aaa7-eaf2e8733f46 req-868438fe-c092-48f4-983d-87f91a9c6729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f800d18-d86c-4d82-9bb8-ce480c8835aa", "name": "network-vif-deleted", "tag": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cc045452-ddf8-49e7-aaa7-eaf2e8733f46 req-868438fe-c092-48f4-983d-87f91a9c6729 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cc045452-ddf8-49e7-aaa7-eaf2e8733f46 req-868438fe-c092-48f4-983d-87f91a9c6729 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cc045452-ddf8-49e7-aaa7-eaf2e8733f46 req-868438fe-c092-48f4-983d-87f91a9c6729 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cc045452-ddf8-49e7-aaa7-eaf2e8733f46 req-868438fe-c092-48f4-983d-87f91a9c6729 service nova] Creating event network-vif-deleted:01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa on user Apr 12 09:16:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cc045452-ddf8-49e7-aaa7-eaf2e8733f46 req-868438fe-c092-48f4-983d-87f91a9c6729 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040539 Apr 12 09:16:17 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 136/405] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=11 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=11 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:24 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2fb51a6b-bdcb-4a1b-b444-6ead86494e07 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 200 len: 1504 microversion: 2.1 time: 0.241734 Apr 12 09:16:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:24 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] HTTP exception thrown: Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d could not be found. Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Request method failure captured: Apr 12 09:16:29 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d HTTP/1.1 Apr 12 09:16:29 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:16:29 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:16:29 user devstack@n-api.service[61855]: Connection: close Apr 12 09:16:29 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:16:29 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:16:29 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:16:29 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:16:29 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnU9ha8vBtqEG5KeNGTi9xEv2xTDGqwefaIpgTsaN_S5dizTHQHa-ed5cLXh3ibsyz2rTXDTgMjIgXDZLfnaTm8wHwnCzmZhv0Fbo11uboOsPnxfglFuuE6ozQyMxkA2PLs_XXwkC9pT7C83QwIY26cwtUcWlYr0fvyXvRcBNU-US3M Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Project-Id: 81d39dd859ed4684a659c79ca3ea3fb4 Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestStampPattern-1126496829 Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81d39dd859ed4684a659c79ca3ea3fb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81d39dd859ed4684a659c79ca3ea3fb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81d39dd859ed4684a659c79ca3ea3fb4"}]}] Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Tenant: tempest-TestStampPattern-1126496829 Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Tenant-Id: 81d39dd859ed4684a659c79ca3ea3fb4 Apr 12 09:16:29 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestStampPattern-1126496829 Apr 12 09:16:29 user devstack@n-api.service[61855]: X-User: tempest-TestStampPattern-1126496829-project-member Apr 12 09:16:29 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:16:29 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:16:29 user devstack@n-api.service[61855]: X-User-Id: e0440debc9af46e690788752e32f0912 Apr 12 09:16:29 user devstack@n-api.service[61855]: X-User-Name: tempest-TestStampPattern-1126496829-project-member Apr 12 09:16:29 user devstack@n-api.service[61855]: method: > Apr 12 09:16:29 user devstack@n-api.service[61855]: exception: Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d could not be found. Apr 12 09:16:29 user devstack@n-api.service[61855]: action_args: {'id': '3872dcd7-8f2e-4b6e-9450-f8939143a94d'} Apr 12 09:16:29 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d could not be found. Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d could not be found. Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d could not be found. Apr 12 09:16:29 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Returning 404 to user: Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:16:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e3bba16c-24e3-4b1d-9820-c6e02ad67075 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d" status: 404 len: 111 microversion: 2.1 time: 0.037099 Apr 12 09:16:29 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 134/407] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:29 2023] GET /compute/v2.1/servers/3872dcd7-8f2e-4b6e-9450-f8939143a94d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=26 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=46 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b139ff6e-c59e-4ac4-a794-4e3acfc38c85 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049533 Apr 12 09:16:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 137/408] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:16:30 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:30 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e80fb822-47c5-4858-a344-0c67b51a48ed tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1675 microversion: 2.1 time: 0.161406 Apr 12 09:16:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 138/409] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:30 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:31 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-ac2463cc-e06d-47ef-893f-d6edbbdb1e3b tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1675 microversion: 2.1 time: 0.157909 Apr 12 09:16:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 135/410] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:30 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d41a1e89-9580-473c-a35d-915511bfb312 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1675 microversion: 2.1 time: 0.156426 Apr 12 09:16:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 138/411] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:31 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] HTTP exception thrown: Instance a5e42339-50fa-411c-94a1-c350727b7955 is not attached to volume 4531b054-1af7-4630-8d73-8f1bac8a7723 Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Request method failure captured: Apr 12 09:16:34 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments/4531b054-1af7-4630-8d73-8f1bac8a7723 HTTP/1.1 Apr 12 09:16:34 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:16:34 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:16:34 user devstack@n-api.service[61853]: Connection: close Apr 12 09:16:34 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:16:34 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:16:34 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:16:34 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:16:34 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnU9ha8vBtqEG5KeNGTi9xEv2xTDGqwefaIpgTsaN_S5dizTHQHa-ed5cLXh3ibsyz2rTXDTgMjIgXDZLfnaTm8wHwnCzmZhv0Fbo11uboOsPnxfglFuuE6ozQyMxkA2PLs_XXwkC9pT7C83QwIY26cwtUcWlYr0fvyXvRcBNU-US3M Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Project-Id: 81d39dd859ed4684a659c79ca3ea3fb4 Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestStampPattern-1126496829 Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81d39dd859ed4684a659c79ca3ea3fb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81d39dd859ed4684a659c79ca3ea3fb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81d39dd859ed4684a659c79ca3ea3fb4"}]}] Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Tenant: tempest-TestStampPattern-1126496829 Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Tenant-Id: 81d39dd859ed4684a659c79ca3ea3fb4 Apr 12 09:16:34 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestStampPattern-1126496829 Apr 12 09:16:34 user devstack@n-api.service[61853]: X-User: tempest-TestStampPattern-1126496829-project-member Apr 12 09:16:34 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:16:34 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:16:34 user devstack@n-api.service[61853]: X-User-Id: e0440debc9af46e690788752e32f0912 Apr 12 09:16:34 user devstack@n-api.service[61853]: X-User-Name: tempest-TestStampPattern-1126496829-project-member Apr 12 09:16:34 user devstack@n-api.service[61853]: method: > Apr 12 09:16:34 user devstack@n-api.service[61853]: exception: Instance a5e42339-50fa-411c-94a1-c350727b7955 is not attached to volume 4531b054-1af7-4630-8d73-8f1bac8a7723 Apr 12 09:16:34 user devstack@n-api.service[61853]: action_args: {'server_id': 'a5e42339-50fa-411c-94a1-c350727b7955', 'id': '4531b054-1af7-4630-8d73-8f1bac8a7723'} Apr 12 09:16:34 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4531b054-1af7-4630-8d73-8f1bac8a7723. Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e42339-50fa-411c-94a1-c350727b7955 is not attached to volume 4531b054-1af7-4630-8d73-8f1bac8a7723 Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e42339-50fa-411c-94a1-c350727b7955 is not attached to volume 4531b054-1af7-4630-8d73-8f1bac8a7723 Apr 12 09:16:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Returning 404 to user: Instance a5e42339-50fa-411c-94a1-c350727b7955 is not attached to volume 4531b054-1af7-4630-8d73-8f1bac8a7723 {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:16:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c538d903-58a4-4d48-8553-2e734f9d2dc9 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments/4531b054-1af7-4630-8d73-8f1bac8a7723" status: 404 len: 154 microversion: 2.1 time: 0.093639 Apr 12 09:16:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 139/412] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:16:34 2023] DELETE /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955/os-volume_attachments/4531b054-1af7-4630-8d73-8f1bac8a7723 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Creating event network-changed:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:16:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031045 Apr 12 09:16:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 139/413] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:16:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955" status: 204 len: 0 microversion: 2.1 time: 0.133508 Apr 12 09:16:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 136/414] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:16:35 2023] DELETE /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:35 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ba556ecb-78f6-438f-b181-108a5aaf863b tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955" status: 200 len: 1661 microversion: 2.1 time: 0.246382 Apr 12 09:16:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 140/415] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:35 2023] GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955 => generated 1661 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:16:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "name": "network-vif-deleted", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] Creating event network-vif-deleted:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:16:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031208 Apr 12 09:16:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 140/416] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "name": "network-vif-unplugged", "status": "completed", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}, {"server_uuid": "a5e42339-50fa-411c-94a1-c350727b7955", "name": "network-vif-plugged", "status": "completed", "tag": "60f2af8d-b456-4efe-b146-cc700b68733e"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Creating event network-vif-unplugged:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:16:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Creating event network-vif-plugged:60f2af8d-b456-4efe-b146-cc700b68733e for instance a5e42339-50fa-411c-94a1-c350727b7955 on user Apr 12 09:16:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031711 Apr 12 09:16:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 137/417] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:37 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Going to try to start instance {{(pid=61853) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 09:16:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action" status: 202 len: 0 microversion: 2.1 time: 0.070796 Apr 12 09:16:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 141/418] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:16:37 2023] POST /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:37 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-fcc7512f-d083-47d0-a60b-04a5a74aa7b2 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1650 microversion: 2.1 time: 0.174245 Apr 12 09:16:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 141/419] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:37 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1650 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:16:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:16:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043890 Apr 12 09:16:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 138/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:16:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:16:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Apr 12 09:16:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 142/421] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:16:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:47 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:16:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-43425f80-9ac1-41bd-ae28-1fcead3543fb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 200 len: 1701 microversion: 2.1 time: 0.171540 Apr 12 09:16:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 142/422] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:16:47 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 1701 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:53 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] HTTP exception thrown: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Request method failure captured: Apr 12 09:16:53 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c HTTP/1.1 Apr 12 09:16:53 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:16:53 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:16:53 user devstack@n-api.service[61855]: Connection: close Apr 12 09:16:53 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:16:53 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:16:53 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:16:53 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:16:53 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnZH8_RcNQd2KjzppcEu0BjoDBFxcSnc-93ZszztsaMqDIPU0AG3YxBvf1u94TqvubGJZyBX89YJhGtGdPPy6sIYd8Qap7REtIdJNjNSBr5wxehQ01zhRniPhQGYwhvVNwCaU3uPvjIHUQDlqwX8YlzjRo7Rq-V7AwEdeJSOG1g7WQc Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Project-Id: fa7c759e2e974720a71b31ddbb2adba8 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa7c759e2e974720a71b31ddbb2adba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa7c759e2e974720a71b31ddbb2adba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa7c759e2e974720a71b31ddbb2adba8"}]}] Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Tenant: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Tenant-Id: fa7c759e2e974720a71b31ddbb2adba8 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-User: tempest-TaggedBootDevicesTest_v242-683378533-project-member Apr 12 09:16:53 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:16:53 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:16:53 user devstack@n-api.service[61855]: X-User-Id: 614726429a894b9499267c0c533330b8 Apr 12 09:16:53 user devstack@n-api.service[61855]: X-User-Name: tempest-TaggedBootDevicesTest_v242-683378533-project-member Apr 12 09:16:53 user devstack@n-api.service[61855]: method: > Apr 12 09:16:53 user devstack@n-api.service[61855]: exception: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:53 user devstack@n-api.service[61855]: action_args: {'id': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'} Apr 12 09:16:53 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:53 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:53 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Returning 404 to user: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:16:53 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d259c4af-5331-4070-8188-65bbae4dc537 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 404 len: 111 microversion: 2.42 time: 0.038517 Apr 12 09:16:53 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 139/423] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:53 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:16:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-89872f19-71ef-4941-baf2-2ab9e477d127 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '.version_select at 0x7fbd5b9a7370>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:53 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:53 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-89872f19-71ef-4941-baf2-2ab9e477d127 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997992342" status: 204 len: 0 microversion: 2.42 time: 0.031196 Apr 12 09:16:53 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 143/424] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 09:16:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997992342 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] HTTP exception thrown: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Request method failure captured: Apr 12 09:16:57 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c HTTP/1.1 Apr 12 09:16:57 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:16:57 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:16:57 user devstack@n-api.service[61854]: Connection: close Apr 12 09:16:57 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:16:57 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:16:57 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:16:57 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:16:57 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnZH8_RcNQd2KjzppcEu0BjoDBFxcSnc-93ZszztsaMqDIPU0AG3YxBvf1u94TqvubGJZyBX89YJhGtGdPPy6sIYd8Qap7REtIdJNjNSBr5wxehQ01zhRniPhQGYwhvVNwCaU3uPvjIHUQDlqwX8YlzjRo7Rq-V7AwEdeJSOG1g7WQc Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Project-Id: fa7c759e2e974720a71b31ddbb2adba8 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa7c759e2e974720a71b31ddbb2adba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa7c759e2e974720a71b31ddbb2adba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa7c759e2e974720a71b31ddbb2adba8"}]}] Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Tenant: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Tenant-Id: fa7c759e2e974720a71b31ddbb2adba8 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-User: tempest-TaggedBootDevicesTest_v242-683378533-project-member Apr 12 09:16:57 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:16:57 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:16:57 user devstack@n-api.service[61854]: X-User-Id: 614726429a894b9499267c0c533330b8 Apr 12 09:16:57 user devstack@n-api.service[61854]: X-User-Name: tempest-TaggedBootDevicesTest_v242-683378533-project-member Apr 12 09:16:57 user devstack@n-api.service[61854]: method: > Apr 12 09:16:57 user devstack@n-api.service[61854]: exception: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61854]: action_args: {'id': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'} Apr 12 09:16:57 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Returning 404 to user: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:16:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d564290a-f01b-4037-aa2d-6caed582d87e tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 404 len: 111 microversion: 2.42 time: 0.033343 Apr 12 09:16:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 143/425] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:16:57 2023] DELETE /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:57 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] HTTP exception thrown: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Request method failure captured: Apr 12 09:16:57 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c HTTP/1.1 Apr 12 09:16:57 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:16:57 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:16:57 user devstack@n-api.service[61855]: Connection: close Apr 12 09:16:57 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:16:57 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:16:57 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:16:57 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:16:57 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnZH8_RcNQd2KjzppcEu0BjoDBFxcSnc-93ZszztsaMqDIPU0AG3YxBvf1u94TqvubGJZyBX89YJhGtGdPPy6sIYd8Qap7REtIdJNjNSBr5wxehQ01zhRniPhQGYwhvVNwCaU3uPvjIHUQDlqwX8YlzjRo7Rq-V7AwEdeJSOG1g7WQc Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Project-Id: fa7c759e2e974720a71b31ddbb2adba8 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa7c759e2e974720a71b31ddbb2adba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa7c759e2e974720a71b31ddbb2adba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa7c759e2e974720a71b31ddbb2adba8"}]}] Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Tenant: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Tenant-Id: fa7c759e2e974720a71b31ddbb2adba8 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-683378533 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-User: tempest-TaggedBootDevicesTest_v242-683378533-project-member Apr 12 09:16:57 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:16:57 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:16:57 user devstack@n-api.service[61855]: X-User-Id: 614726429a894b9499267c0c533330b8 Apr 12 09:16:57 user devstack@n-api.service[61855]: X-User-Name: tempest-TaggedBootDevicesTest_v242-683378533-project-member Apr 12 09:16:57 user devstack@n-api.service[61855]: method: > Apr 12 09:16:57 user devstack@n-api.service[61855]: exception: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61855]: action_args: {'id': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'} Apr 12 09:16:57 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. Apr 12 09:16:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:16:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Returning 404 to user: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:16:57 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-31b640d3-56f2-4a32-964c-41dc67cdc6a0 tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" status: 404 len: 111 microversion: 2.42 time: 0.027670 Apr 12 09:16:57 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 140/426] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:57 2023] GET /compute/v2.1/servers/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:16:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] HTTP exception thrown: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Request method failure captured: Apr 12 09:16:58 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa HTTP/1.1 Apr 12 09:16:58 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:16:58 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:16:58 user devstack@n-api.service[61853]: Connection: close Apr 12 09:16:58 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:16:58 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:16:58 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:16:58 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:16:58 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnZQ5NA4QQ2BfloMjfK62jIOfC5tJ8rqeIuPNwBiXTcBt8UxltLScVGk_UqDlcZkD0Zen5Hk6fcPw_Rqjyf-nFJxgT0rxpxw_JseoWTrXsuE_VUHlHLoWGYCr4WdLj85gxc9Tp506rWHR8rrGEGzDnEEpjhe_91XBR7FZvuwiH-rZXg Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Project-Id: 5ce13a09e5b842b1997cee5123e0f167 Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Project-Name: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ce13a09e5b842b1997cee5123e0f167"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ce13a09e5b842b1997cee5123e0f167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ce13a09e5b842b1997cee5123e0f167"}]}] Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Tenant: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Tenant-Id: 5ce13a09e5b842b1997cee5123e0f167 Apr 12 09:16:58 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:16:58 user devstack@n-api.service[61853]: X-User: tempest-TaggedBootDevicesTest-1718738212-project-member Apr 12 09:16:58 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:16:58 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:16:58 user devstack@n-api.service[61853]: X-User-Id: 40052fbebbb4401f89f591ca889b0cfa Apr 12 09:16:58 user devstack@n-api.service[61853]: X-User-Name: tempest-TaggedBootDevicesTest-1718738212-project-member Apr 12 09:16:58 user devstack@n-api.service[61853]: method: > Apr 12 09:16:58 user devstack@n-api.service[61853]: exception: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:16:58 user devstack@n-api.service[61853]: action_args: {'id': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'} Apr 12 09:16:58 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:16:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:16:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Returning 404 to user: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:16:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ce27d18d-c996-43b3-be5d-688320bd2132 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 404 len: 111 microversion: 2.32 time: 0.030474 Apr 12 09:16:58 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 144/427] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:16:58 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:16:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6c7d2160-b6c9-438a-b2a4-9f11ff2196ea tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '.version_select at 0x7fbd5bae9ab0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:16:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6c7d2160-b6c9-438a-b2a4-9f11ff2196ea tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302183567" status: 204 len: 0 microversion: 2.32 time: 0.024996 Apr 12 09:16:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 144/428] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 09:16:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302183567 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] HTTP exception thrown: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Request method failure captured: Apr 12 09:17:01 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa HTTP/1.1 Apr 12 09:17:01 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:17:01 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:17:01 user devstack@n-api.service[61855]: Connection: close Apr 12 09:17:01 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:17:01 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:17:01 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:17:01 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:17:01 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnZQ5NA4QQ2BfloMjfK62jIOfC5tJ8rqeIuPNwBiXTcBt8UxltLScVGk_UqDlcZkD0Zen5Hk6fcPw_Rqjyf-nFJxgT0rxpxw_JseoWTrXsuE_VUHlHLoWGYCr4WdLj85gxc9Tp506rWHR8rrGEGzDnEEpjhe_91XBR7FZvuwiH-rZXg Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Project-Id: 5ce13a09e5b842b1997cee5123e0f167 Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Project-Name: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ce13a09e5b842b1997cee5123e0f167"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ce13a09e5b842b1997cee5123e0f167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ce13a09e5b842b1997cee5123e0f167"}]}] Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Tenant: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Tenant-Id: 5ce13a09e5b842b1997cee5123e0f167 Apr 12 09:17:01 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:17:01 user devstack@n-api.service[61855]: X-User: tempest-TaggedBootDevicesTest-1718738212-project-member Apr 12 09:17:01 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:17:01 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:17:01 user devstack@n-api.service[61855]: X-User-Id: 40052fbebbb4401f89f591ca889b0cfa Apr 12 09:17:01 user devstack@n-api.service[61855]: X-User-Name: tempest-TaggedBootDevicesTest-1718738212-project-member Apr 12 09:17:01 user devstack@n-api.service[61855]: method: > Apr 12 09:17:01 user devstack@n-api.service[61855]: exception: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61855]: action_args: {'id': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'} Apr 12 09:17:01 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Returning 404 to user: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:17:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-7c39a8a0-c51e-46b0-b12f-c87209b3c9dc tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 404 len: 111 microversion: 2.32 time: 0.035077 Apr 12 09:17:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 141/429] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:17:01 2023] DELETE /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] HTTP exception thrown: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Request method failure captured: Apr 12 09:17:01 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa HTTP/1.1 Apr 12 09:17:01 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:17:01 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:17:01 user devstack@n-api.service[61853]: Connection: close Apr 12 09:17:01 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:17:01 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:17:01 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:17:01 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:17:01 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnZQ5NA4QQ2BfloMjfK62jIOfC5tJ8rqeIuPNwBiXTcBt8UxltLScVGk_UqDlcZkD0Zen5Hk6fcPw_Rqjyf-nFJxgT0rxpxw_JseoWTrXsuE_VUHlHLoWGYCr4WdLj85gxc9Tp506rWHR8rrGEGzDnEEpjhe_91XBR7FZvuwiH-rZXg Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Project-Id: 5ce13a09e5b842b1997cee5123e0f167 Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Project-Name: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ce13a09e5b842b1997cee5123e0f167"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ce13a09e5b842b1997cee5123e0f167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ce13a09e5b842b1997cee5123e0f167"}]}] Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Tenant: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Tenant-Id: 5ce13a09e5b842b1997cee5123e0f167 Apr 12 09:17:01 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1718738212 Apr 12 09:17:01 user devstack@n-api.service[61853]: X-User: tempest-TaggedBootDevicesTest-1718738212-project-member Apr 12 09:17:01 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:17:01 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:17:01 user devstack@n-api.service[61853]: X-User-Id: 40052fbebbb4401f89f591ca889b0cfa Apr 12 09:17:01 user devstack@n-api.service[61853]: X-User-Name: tempest-TaggedBootDevicesTest-1718738212-project-member Apr 12 09:17:01 user devstack@n-api.service[61853]: method: > Apr 12 09:17:01 user devstack@n-api.service[61853]: exception: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61853]: action_args: {'id': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'} Apr 12 09:17:01 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. Apr 12 09:17:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:17:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Returning 404 to user: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:17:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1ff98254-9e5c-4fd9-82a0-be39d35432ed tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa" status: 404 len: 111 microversion: 2.32 time: 0.041281 Apr 12 09:17:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 145/430] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:17:01 2023] GET /compute/v2.1/servers/6f800d18-d86c-4d82-9bb8-ce480c8835aa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 09:17:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=30 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-206066750", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:09 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] validate_networks() for [('a0210d9b-0f71-4647-9f96-c9cbe32cc3d8', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for user cc51704e74b045ad9733a43aec982390 and project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:17:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:17:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.660354 Apr 12 09:17:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 145/431] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 09:17:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:17:10 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4833072c-d599-41fe-be86-bdf66bcee934 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:10 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4833072c-d599-41fe-be86-bdf66bcee934 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:10 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-4833072c-d599-41fe-be86-bdf66bcee934 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:10 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-4833072c-d599-41fe-be86-bdf66bcee934 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:10 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-4833072c-d599-41fe-be86-bdf66bcee934 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4833072c-d599-41fe-be86-bdf66bcee934 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef" status: 200 len: 1394 microversion: 2.87 time: 0.085611 Apr 12 09:17:10 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 142/432] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:17:10 2023] GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef => generated 1394 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:17:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e442604c-86f4-45e1-9407-1764133852ef", "tag": "c456f016-a187-4f16-9a25-2ae020e10413"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Creating event network-changed:c456f016-a187-4f16-9a25-2ae020e10413 for instance e442604c-86f4-45e1-9407-1764133852ef on user Apr 12 09:17:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037854 Apr 12 09:17:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 146/433] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e442604c-86f4-45e1-9407-1764133852ef", "name": "network-vif-plugged", "status": "completed", "tag": "c456f016-a187-4f16-9a25-2ae020e10413"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Creating event network-vif-plugged:c456f016-a187-4f16-9a25-2ae020e10413 for instance e442604c-86f4-45e1-9407-1764133852ef on user Apr 12 09:17:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041378 Apr 12 09:17:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 146/434] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:18 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e442604c-86f4-45e1-9407-1764133852ef", "name": "network-vif-plugged", "status": "completed", "tag": "c456f016-a187-4f16-9a25-2ae020e10413"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:18 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:18 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Creating event network-vif-plugged:c456f016-a187-4f16-9a25-2ae020e10413 for instance e442604c-86f4-45e1-9407-1764133852ef on user Apr 12 09:17:18 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028403 Apr 12 09:17:18 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 143/435] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c8d7bfbf-fa9f-4d9e-809c-f9d6a09a14a1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b9a5cf0>, body: {"keypair": {"name": "tempest-keypair-501602451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4JkdmcZevwkBRIvOxZXR/GY5jcnavNiZ74hKGbOyliYHO5bVun8yU8w+4IBWoQC5ayotvjMWHRPPGubYFeG7cJoQLiULRqOwjpOnp0kPQmpgv3dBxk2vLFWpUFCoUImw=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:22 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-c8d7bfbf-fa9f-4d9e-809c-f9d6a09a14a1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:22 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-c8d7bfbf-fa9f-4d9e-809c-f9d6a09a14a1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for user d76daece06a943668e6c1c3c2c57ebaa and project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c8d7bfbf-fa9f-4d9e-809c-f9d6a09a14a1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.199483 Apr 12 09:17:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 147/436] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 09:17:22 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 09:17:25 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:25 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-325803830", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1da53f15-1745-4e97-beac-302695973f1f"}], "security_groups": [{"name": "tempest-securitygroup--801006495"}], "key_name": "tempest-keypair-501602451", "user_data": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:25 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] validate_networks() for [('1da53f15-1745-4e97-beac-302695973f1f', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=15 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:25 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] HTTP exception thrown: Instance a5e42339-50fa-411c-94a1-c350727b7955 could not be found. Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Request method failure captured: Apr 12 09:17:25 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955 HTTP/1.1 Apr 12 09:17:25 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:17:25 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:17:25 user devstack@n-api.service[61855]: Connection: close Apr 12 09:17:25 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:17:25 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:17:25 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:17:25 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:17:25 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnU9ha8vBtqEG5KeNGTi9xEv2xTDGqwefaIpgTsaN_S5dizTHQHa-ed5cLXh3ibsyz2rTXDTgMjIgXDZLfnaTm8wHwnCzmZhv0Fbo11uboOsPnxfglFuuE6ozQyMxkA2PLs_XXwkC9pT7C83QwIY26cwtUcWlYr0fvyXvRcBNU-US3M Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Project-Id: 81d39dd859ed4684a659c79ca3ea3fb4 Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestStampPattern-1126496829 Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81d39dd859ed4684a659c79ca3ea3fb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81d39dd859ed4684a659c79ca3ea3fb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81d39dd859ed4684a659c79ca3ea3fb4"}]}] Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Tenant: tempest-TestStampPattern-1126496829 Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Tenant-Id: 81d39dd859ed4684a659c79ca3ea3fb4 Apr 12 09:17:25 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestStampPattern-1126496829 Apr 12 09:17:25 user devstack@n-api.service[61855]: X-User: tempest-TestStampPattern-1126496829-project-member Apr 12 09:17:25 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:17:25 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:17:25 user devstack@n-api.service[61855]: X-User-Id: e0440debc9af46e690788752e32f0912 Apr 12 09:17:25 user devstack@n-api.service[61855]: X-User-Name: tempest-TestStampPattern-1126496829-project-member Apr 12 09:17:25 user devstack@n-api.service[61855]: method: > Apr 12 09:17:25 user devstack@n-api.service[61855]: exception: Instance a5e42339-50fa-411c-94a1-c350727b7955 could not be found. Apr 12 09:17:25 user devstack@n-api.service[61855]: action_args: {'id': 'a5e42339-50fa-411c-94a1-c350727b7955'} Apr 12 09:17:25 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e42339-50fa-411c-94a1-c350727b7955 could not be found. Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e42339-50fa-411c-94a1-c350727b7955 could not be found. Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e42339-50fa-411c-94a1-c350727b7955 could not be found. Apr 12 09:17:25 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:17:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Returning 404 to user: Instance a5e42339-50fa-411c-94a1-c350727b7955 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:17:25 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-67f98264-4bf3-4fa8-9729-b26fbf4e0e6c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955" status: 404 len: 111 microversion: 2.1 time: 0.053938 Apr 12 09:17:25 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 144/437] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:17:25 2023] GET /compute/v2.1/servers/a5e42339-50fa-411c-94a1-c350727b7955 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:17:25 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-070bf404-5c75-4a51-87b9-dc48476b1356 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b8941f0>, body: {"keypair": {"name": "tempest-keypair-65745046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcgOlYUwNuWHn3k/8NhVfKcsRRf00AtvCUtT94690EyQkY6DJedMcCl0px8XoQgNE4fdJsdkSkN6tuvI98c71siFzbUZTepADTU9efkAxglWffFn8akoG6jZa+wPJijqg=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:25 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-070bf404-5c75-4a51-87b9-dc48476b1356 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:25 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-070bf404-5c75-4a51-87b9-dc48476b1356 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-070bf404-5c75-4a51-87b9-dc48476b1356 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.125154 Apr 12 09:17:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 148/438] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:17:25 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for user d76daece06a943668e6c1c3c2c57ebaa and project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:17:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:17:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.099417 Apr 12 09:17:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 147/439] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 09:17:25 2023] POST /compute/v2.1/servers => generated 399 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:17:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d7b0fffe-8462-441e-9d87-ef8a9873bbfe tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:26 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d7b0fffe-8462-441e-9d87-ef8a9873bbfe tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:26 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d7b0fffe-8462-441e-9d87-ef8a9873bbfe tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:26 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d7b0fffe-8462-441e-9d87-ef8a9873bbfe tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:26 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d7b0fffe-8462-441e-9d87-ef8a9873bbfe tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:26 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d7b0fffe-8462-441e-9d87-ef8a9873bbfe tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 200 len: 1274 microversion: 2.20 time: 0.082702 Apr 12 09:17:26 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 145/440] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:17:26 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f0646af9-7649-4962-9945-a3b5c17ecf96 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'create', calling method: .version_select at 0x7fbd5bd9be20>, body: {"keypair": {"name": "tempest-keypair-1774942187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRFQGCKpi8fjGcdpMDws7TZ+hZpwQGB4rtL60LdXbaRXqJvmTcXhTPGYdQ+Z42mEAB4P05g7T0Z0J2ARvc+I4t9vDocY1CSO+itTj8pMWaDXEEILwFmJvFWolS0ihRs3g=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:27 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-f0646af9-7649-4962-9945-a3b5c17ecf96 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:27 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-f0646af9-7649-4962-9945-a3b5c17ecf96 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for user 7f6b983634234693ba04a3097c2a129b and project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f0646af9-7649-4962-9945-a3b5c17ecf96 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052416 Apr 12 09:17:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 148/441] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:17:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f9f2d2da-18b2-4947-b34f-ea02b537f254 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1654 microversion: 2.1 time: 0.623882 Apr 12 09:17:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:17:27 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1654 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:17:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1730277833", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9900741d-c340-4245-aeef-59065c45b165"}], "security_groups": [{"name": "tempest-securitygroup--2013061298"}], "key_name": "tempest-keypair-65745046", "user_data": "}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:28 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] validate_networks() for [('9900741d-c340-4245-aeef-59065c45b165', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cead0a7d-80ef-433d-8bae-6e1fc4dea206 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Calling method '.version_select at 0x7fbd5baea950>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:17:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cead0a7d-80ef-433d-8bae-6e1fc4dea206 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1475014031" status: 202 len: 0 microversion: 2.1 time: 0.028317 Apr 12 09:17:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 149/443] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:17:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1475014031 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:17:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.763000 Apr 12 09:17:29 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 146/444] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:17:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:17:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-537cea8c-7c91-431e-b936-24f521e69640 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:29 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-537cea8c-7c91-431e-b936-24f521e69640 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:29 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-537cea8c-7c91-431e-b936-24f521e69640 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-537cea8c-7c91-431e-b936-24f521e69640 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d" status: 200 len: 1234 microversion: 2.1 time: 0.072741 Apr 12 09:17:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 150/445] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:17:29 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d => generated 1234 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:17:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Creating event network-changed:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:17:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035449 Apr 12 09:17:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 150/446] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1045691490", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "699e7817-78bb-4ca0-bc59-8dd53b630c9b"}], "security_groups": [{"name": "tempest-securitygroup--945478335"}], "key_name": "tempest-keypair-1774942187", "user_data": "}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:29 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] validate_networks() for [('699e7817-78bb-4ca0-bc59-8dd53b630c9b', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting quotas for user 7f6b983634234693ba04a3097c2a129b and project 1c3cc8ab6ab244b1badb6fea347d64ea. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:17:30 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:17:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.978102 Apr 12 09:17:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 147/447] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:17:29 2023] POST /compute/v2.1/servers => generated 406 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 09:17:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-83bbcb81-a31e-4ee3-93ca-a6ed2a9d3558 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-83bbcb81-a31e-4ee3-93ca-a6ed2a9d3558 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:30 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-83bbcb81-a31e-4ee3-93ca-a6ed2a9d3558 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-83bbcb81-a31e-4ee3-93ca-a6ed2a9d3558 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 200 len: 1240 microversion: 2.1 time: 0.085649 Apr 12 09:17:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 151/448] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:17:30 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:17:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Creating event network-vif-plugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:17:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041899 Apr 12 09:17:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 151/449] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:32 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f4061d92-f4f8-4171-8900-edf563da35b4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1675 microversion: 2.1 time: 0.210900 Apr 12 09:17:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 148/450] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:17:32 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1675 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d6b141c-5f82-4aed-b319-8579a78c6c58"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9691009c-8aca-4347-8e46-c5bdda13aa3d", "tag": "3fe5d678-976e-467d-888f-4575a3cc2efe"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Creating event network-changed:3fe5d678-976e-467d-888f-4575a3cc2efe for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d on user Apr 12 09:17:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030189 Apr 12 09:17:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 152/451] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429121 Apr 12 09:17:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 152/452] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:17:32 2023] POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Creating event network-vif-plugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:17:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031558 Apr 12 09:17:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 149/453] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Creating event network-changed:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:17:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034858 Apr 12 09:17:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 153/454] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9691009c-8aca-4347-8e46-c5bdda13aa3d", "name": "network-vif-plugged", "status": "completed", "tag": "3fe5d678-976e-467d-888f-4575a3cc2efe"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Creating event network-vif-plugged:3fe5d678-976e-467d-888f-4575a3cc2efe for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d on user Apr 12 09:17:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047140 Apr 12 09:17:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 153/455] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9691009c-8aca-4347-8e46-c5bdda13aa3d", "name": "network-vif-plugged", "status": "completed", "tag": "3fe5d678-976e-467d-888f-4575a3cc2efe"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Creating event network-vif-plugged:3fe5d678-976e-467d-888f-4575a3cc2efe for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d on user Apr 12 09:17:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035229 Apr 12 09:17:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 150/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:17:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047274 Apr 12 09:17:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 154/457] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:17:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029767 Apr 12 09:17:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 154/458] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=14 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Old instance type m1.nano, new instance type m1.micro {{(pid=61855) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for user 375db5b9a80244d3878822049230ba47 and project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:17:41 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:17:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/action" status: 202 len: 0 microversion: 2.1 time: 0.316913 Apr 12 09:17:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 151/459] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:17:41 2023] POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=17 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:41 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:17:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-71d34848-a67d-4119-a2d1-ac8cfd08c32c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1730 microversion: 2.1 time: 0.215747 Apr 12 09:17:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 155/460] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:17:41 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:17:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-unplugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Creating event network-vif-unplugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:17:44 user devstack@n-api.service[61853]: DEBUG nova.compute.api [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Instance 4f211820-161b-4bef-b25d-ced137325da1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61853) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:17:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068598 Apr 12 09:17:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 155/461] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:17:46 user devstack@n-api.service[61855]: DEBUG nova.compute.api [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Instance 4f211820-161b-4bef-b25d-ced137325da1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61855) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:17:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051447 Apr 12 09:17:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 152/462] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/action" status: 202 len: 0 microversion: 2.1 time: 0.294029 Apr 12 09:17:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 156/463] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:17:47 2023] POST /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a94b8835-a4cb-4814-8321-9da471154ef6 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.098144 Apr 12 09:17:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 156/464] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:17:47 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-interface => generated 283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:48 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Creating event network-changed:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:17:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042613 Apr 12 09:17:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 153/465] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-unplugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Creating event network-vif-unplugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:17:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044139 Apr 12 09:17:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 157/466] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Creating event network-changed:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:17:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030187 Apr 12 09:17:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 157/467] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:17:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053349 Apr 12 09:17:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 154/468] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}, {"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:17:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:17:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031718 Apr 12 09:17:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 158/469] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:55 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:17:55 user devstack@n-api.service[61853]: DEBUG nova.compute.api [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Instance 4f211820-161b-4bef-b25d-ced137325da1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61853) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:17:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055522 Apr 12 09:17:55 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 158/470] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:17:57 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:58 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:17:58 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:17:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:17:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:17:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:17:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:17:58 user devstack@n-api.service[61855]: DEBUG nova.compute.api [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Instance 4f211820-161b-4bef-b25d-ced137325da1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61855) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:17:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039234 Apr 12 09:17:58 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 155/471] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:17:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-fed6eb23-3deb-44aa-93fb-07c51cb5022c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef" status: 200 len: 1691 microversion: 2.87 time: 0.188730 Apr 12 09:18:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 159/472] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:18:00 2023] GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=7 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:16 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b869c796-fbb3-4e1c-a38a-e9b574c8c9c3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 200 len: 1586 microversion: 2.20 time: 0.152171 Apr 12 09:18:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 159/473] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:18:16 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 1586 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=7 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:19 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-9fffc92a-3aff-4eb0-875e-e181d430092a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d" status: 200 len: 1544 microversion: 2.1 time: 0.168730 Apr 12 09:18:19 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 156/474] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:18:19 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d => generated 1544 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=11 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:20 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'services' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:18:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments/ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927" status: 202 len: 0 microversion: 2.1 time: 0.176959 Apr 12 09:18:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 160/475] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:18:20 2023] DELETE /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments/ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-87d6b057-bc10-448c-adfd-666a2ed2b079 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054213 Apr 12 09:18:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 160/476] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:18:20 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:20 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f2b87112-82ab-4e2c-ba97-50aef44db986 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 200 len: 1553 microversion: 2.1 time: 0.157288 Apr 12 09:18:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 157/477] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:18:20 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5efde16d-f88d-41cb-93ac-6cd883d9f288 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043225 Apr 12 09:18:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 161/478] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:18:28 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:18:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 204 len: 0 microversion: 2.1 time: 0.115333 Apr 12 09:18:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 161/479] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:18:28 2023] DELETE /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:28 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-eaa30ec7-c5ae-4c82-8975-6fb815a74447 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 200 len: 1660 microversion: 2.1 time: 0.223033 Apr 12 09:18:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 158/480] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:18:28 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 1660 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-unplugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Creating event network-vif-unplugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:18:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029705 Apr 12 09:18:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 162/481] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:18:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:18:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-5314bad1-4930-44f4-99ff-30502595daa4 req-fae4e1b2-042d-4326-b7f3-5e1d9be425a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-deleted", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:18:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-5314bad1-4930-44f4-99ff-30502595daa4 req-fae4e1b2-042d-4326-b7f3-5e1d9be425a6 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-5314bad1-4930-44f4-99ff-30502595daa4 req-fae4e1b2-042d-4326-b7f3-5e1d9be425a6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-5314bad1-4930-44f4-99ff-30502595daa4 req-fae4e1b2-042d-4326-b7f3-5e1d9be425a6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-5314bad1-4930-44f4-99ff-30502595daa4 req-fae4e1b2-042d-4326-b7f3-5e1d9be425a6 service nova] Creating event network-vif-deleted:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:18:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-5314bad1-4930-44f4-99ff-30502595daa4 req-fae4e1b2-042d-4326-b7f3-5e1d9be425a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035463 Apr 12 09:18:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 162/482] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:18:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f683bc12-8fca-47de-b28e-a0070e77b387", "name": "network-vif-plugged", "status": "completed", "tag": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:18:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Creating event network-vif-plugged:e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance f683bc12-8fca-47de-b28e-a0070e77b387 on user Apr 12 09:18:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028086 Apr 12 09:18:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 159/483] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:18:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:18:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1815d702-d51b-45e0-a90d-17cd8115e506 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1729 microversion: 2.1 time: 0.155540 Apr 12 09:18:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 163/484] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:18:31 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2060217493"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef/action" status: 202 len: 52 microversion: 2.87 time: 1.049249 Apr 12 09:19:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 163/485] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:19:00 2023] POST /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef/action => generated 52 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=8 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=20 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:07 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:07 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e5634a3c-f959-4cb1-b40d-eb97959293ad tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef" status: 200 len: 1691 microversion: 2.87 time: 0.161859 Apr 12 09:19:07 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 160/486] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:19:07 2023] GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2fc461e5-45d4-40d8-b59b-03444951f5ed tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045778 Apr 12 09:19:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 164/487] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:19:10 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:19:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1221d148-1e50-43e0-87e0-57b320325b97 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '.version_select at 0x7fbd5b896c20>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1221d148-1e50-43e0-87e0-57b320325b97 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115" status: 204 len: 0 microversion: 2.1 time: 0.229269 Apr 12 09:19:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 164/488] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:19:12 2023] DELETE /compute/v2.1/images/86dc6d0f-1950-42bf-bc62-aaa37f02c115 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:13 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:19:13 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 204 len: 0 microversion: 2.1 time: 0.120625 Apr 12 09:19:13 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 161/489] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:19:13 2023] DELETE /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-dc7b1558-c0e1-40d5-898c-3083913f247f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 200 len: 1675 microversion: 2.1 time: 0.232742 Apr 12 09:19:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 165/490] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:19:13 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:19:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-unplugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Creating event network-vif-unplugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:19:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092724 Apr 12 09:19:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 165/491] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-plugged", "status": "completed", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}, {"server_uuid": "7cec0e09-36ac-43c7-9299-819b65c9da6b", "name": "network-vif-deleted", "tag": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Creating event network-vif-plugged:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:19:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Creating event network-vif-deleted:dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b on user Apr 12 09:19:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029983 Apr 12 09:19:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 162/492] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-05a7074b-41d0-40e7-b5e7-7d5addfb3efc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.119331 Apr 12 09:19:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 166/493] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 09:19:16 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-interface => generated 283 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:19:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Creating event network-changed:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:19:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033549 Apr 12 09:19:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 166/494] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-8afd57c4-3acd-4f47-a73d-d469e970a22b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/ips" status: 200 len: 111 microversion: 2.20 time: 0.036628 Apr 12 09:19:17 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 163/495] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 09:19:17 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/ips => generated 111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HTTP exception thrown: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Request method failure captured: Apr 12 09:19:18 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 HTTP/1.1 Apr 12 09:19:18 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:19:18 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:19:18 user devstack@n-api.service[61854]: Connection: close Apr 12 09:19:18 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:19:18 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:19:18 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:19:18 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:19:18 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUf5dB1cGapqNH4ZMiB5U17GS_OsqCgOrnFNkgZhLOlm8rrDoHTBiSnDwLJuRtVVBbYS1aViNhVaQluGL_giASTARnulQ3qeeyf8V9JEPYJuPp8Dcn1j3v-4GRzBg_cswKAcgsO-GVNHx8D_ALbqXsuKHeHjJWj5TXzDxcd2VdOqZE Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Project-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}] Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Tenant-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:19:18 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:19:18 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:19:18 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:19:18 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:19:18 user devstack@n-api.service[61854]: X-User-Id: 2a3731bf575c44d89211709cb07060b7 Apr 12 09:19:18 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:19:18 user devstack@n-api.service[61854]: method: > Apr 12 09:19:18 user devstack@n-api.service[61854]: exception: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:19:18 user devstack@n-api.service[61854]: action_args: {'id': 'f683bc12-8fca-47de-b28e-a0070e77b387'} Apr 12 09:19:18 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:19:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:19:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Returning 404 to user: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:19:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-966a4a1b-36fe-4635-b49b-4fce84efb458 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 404 len: 111 microversion: 2.1 time: 0.039230 Apr 12 09:19:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 167/496] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:19:18 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:19:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f1f53c1f-084c-40e3-91ef-3d59a3990b93 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '.version_select at 0x7fbd5b894550>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f1f53c1f-084c-40e3-91ef-3d59a3990b93 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058620837" status: 202 len: 0 microversion: 2.1 time: 0.021408 Apr 12 09:19:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 167/497] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 09:19:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058620837 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:19 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'flavor' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-99ea345c-555a-4e99-b01b-b19a6abe14cf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'create', calling method: .version_select at 0x7fbd5be676d0>, body: {"keypair": {"name": "tempest-keypair-1500886200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnIl9SCgl+gRiGEuXiMy4XMrc+rm4KKN6tg61KVSaw3G+aWg0i33luIdnCph1+ecByAmzSyxMPbfHh84em5kfq5+K4QbOBA63ZAz57V7w3I+7WSQCtggno/5IECnki4VA=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-99ea345c-555a-4e99-b01b-b19a6abe14cf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-99ea345c-555a-4e99-b01b-b19a6abe14cf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for user 2a3731bf575c44d89211709cb07060b7 and project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:19:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-99ea345c-555a-4e99-b01b-b19a6abe14cf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045790 Apr 12 09:19:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 168/498] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:19:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-069be87e-bc6c-4389-b108-f65583cd404c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.107589 Apr 12 09:19:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 168/499] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:19:19 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-interface => generated 283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/action" status: 202 len: 0 microversion: 2.20 time: 0.792169 Apr 12 09:19:19 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 164/500] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:19:19 2023] POST /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-96957d31-a6bd-4ab4-b067-9f7ff96ed9b4 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 200 len: 1711 microversion: 2.20 time: 0.240379 Apr 12 09:19:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 169/501] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:19:19 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 1711 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:19:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Creating event network-vif-unplugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:19:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031813 Apr 12 09:19:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 169/502] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9691009c-8aca-4347-8e46-c5bdda13aa3d", "tag": "3fe5d678-976e-467d-888f-4575a3cc2efe"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Creating event network-changed:3fe5d678-976e-467d-888f-4575a3cc2efe for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d on user Apr 12 09:19:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034731 Apr 12 09:19:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 165/503] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5d20dd23-8a8d-4e06-b597-e24de324b240 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/ips" status: 200 len: 108 microversion: 2.1 time: 0.039591 Apr 12 09:19:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 170/504] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:19:20 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-77cccc90-6055-4a13-ad15-178ef6404cb2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.127676 Apr 12 09:19:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 170/505] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:19:21 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-interface => generated 283 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:21 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1998611823", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "61984664-d574-4fe6-bed1-a2eb1a52b843"}], "security_groups": [{"name": "tempest-securitygroup--779671521"}], "key_name": "tempest-keypair-1500886200", "user_data": "}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:21 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] validate_networks() for [('61984664-d574-4fe6-bed1-a2eb1a52b843', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Creating event network-changed:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:19:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032116 Apr 12 09:19:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 171/506] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1961f4e-4a3f-46cc-95a2-6177a29efeb2"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85f0b6fa-1590-4f2f-a26b-e7a3e236ea86"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338274 Apr 12 09:19:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 171/507] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:19:22 2023] POST /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323689 Apr 12 09:19:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 172/508] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:19:22 2023] POST /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Creating event network-vif-plugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:19:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037179 Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:19:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 172/509] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting quotas for user 2a3731bf575c44d89211709cb07060b7 and project 23e6ce78ce3d4eb5b4bbb307665c3670. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:19:22 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:19:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.162226 Apr 12 09:19:22 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 166/510] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:19:21 2023] POST /compute/v2.1/servers => generated 399 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-250a7ea5-d3f3-4dae-860c-66e968a3a9d4 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-250a7ea5-d3f3-4dae-860c-66e968a3a9d4 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:22 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-250a7ea5-d3f3-4dae-860c-66e968a3a9d4 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-250a7ea5-d3f3-4dae-860c-66e968a3a9d4 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2" status: 200 len: 1232 microversion: 2.1 time: 0.072276 Apr 12 09:19:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 173/511] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:19:22 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 => generated 1232 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:19:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Creating event network-changed:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:19:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Apr 12 09:19:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 173/512] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:19:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c2cdd1-9214-4678-91a0-40fdb74403a2", "tag": "49c0392a-a4e7-4b73-af28-79c87a052cd8"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Creating event network-changed:49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 on user Apr 12 09:19:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034180 Apr 12 09:19:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 167/513] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c2cdd1-9214-4678-91a0-40fdb74403a2", "name": "network-vif-plugged", "status": "completed", "tag": "49c0392a-a4e7-4b73-af28-79c87a052cd8"}, {"server_uuid": "73c2cdd1-9214-4678-91a0-40fdb74403a2", "name": "network-vif-plugged", "status": "completed", "tag": "49c0392a-a4e7-4b73-af28-79c87a052cd8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Creating event network-vif-plugged:49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 on user Apr 12 09:19:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Creating event network-vif-plugged:49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 on user Apr 12 09:19:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029697 Apr 12 09:19:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 174/514] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-03760e19-0e94-4b48-b34c-d65bee7fb9f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b896440>, body: {"keypair": {"name": "tempest-keypair-874485369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP51TTucuI9vEnyIAeef4Vp7Qq8j+8RA/jR7dkk8rngksIPTjdIVW+QOnQJiPAfRnKEEkjxS/df5PFigO92DmtNDYjq1D17xkh5ij081vpoDIttqa+Y9KL2Mvy4sU65NvQ=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:30 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-03760e19-0e94-4b48-b34c-d65bee7fb9f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:19:30 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-03760e19-0e94-4b48-b34c-d65bee7fb9f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:19:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-03760e19-0e94-4b48-b34c-d65bee7fb9f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047834 Apr 12 09:19:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 174/515] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:19:30 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:19:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/action" status: 200 len: 32 microversion: 2.1 time: 0.180151 Apr 12 09:19:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 168/516] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:19:31 2023] POST /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8a35bbc9-787d-4c53-bc51-a2de531f4aa6 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 200 len: 1723 microversion: 2.1 time: 0.155467 Apr 12 09:19:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 175/517] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:19:31 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:19:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-451080542", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9900741d-c340-4245-aeef-59065c45b165"}], "security_groups": [{"name": "tempest-securitygroup--505640045"}], "key_name": "tempest-keypair-874485369", "user_data": "}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] validate_networks() for [('9900741d-c340-4245-aeef-59065c45b165', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:19:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/action" status: 202 len: 0 microversion: 2.1 time: 0.208934 Apr 12 09:19:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 169/518] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:19:31 2023] POST /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Creating event network-vif-unplugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:19:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034850 Apr 12 09:19:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 170/519] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:32 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-717e555f-ae17-4822-9e0d-9b95fcfc1b5d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1728 microversion: 2.1 time: 0.324039 Apr 12 09:19:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 176/520] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:19:32 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:19:32 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:19:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.028332 Apr 12 09:19:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 175/521] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:19:31 2023] POST /compute/v2.1/servers => generated 399 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-adca8e4c-3731-4cf0-b142-c0b3428bbd56 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-adca8e4c-3731-4cf0-b142-c0b3428bbd56 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:19:32 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-adca8e4c-3731-4cf0-b142-c0b3428bbd56 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:19:33 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-adca8e4c-3731-4cf0-b142-c0b3428bbd56 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" status: 200 len: 1234 microversion: 2.1 time: 0.078491 Apr 12 09:19:33 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 171/522] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:19:32 2023] GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => generated 1234 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:19:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}, {"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-unplugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}, {"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:19:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Creating event network-vif-unplugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:19:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:19:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Instance 4f211820-161b-4bef-b25d-ced137325da1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61854) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:19:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.052047 Apr 12 09:19:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 177/523] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:34 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6", "tag": "45389f3c-d497-46bd-bb7e-78f6c977674a"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Creating event network-changed:45389f3c-d497-46bd-bb7e-78f6c977674a for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 on user Apr 12 09:19:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032870 Apr 12 09:19:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 176/524] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}, {"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:19:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:19:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040092 Apr 12 09:19:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 172/525] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6", "name": "network-vif-plugged", "status": "completed", "tag": "45389f3c-d497-46bd-bb7e-78f6c977674a"}, {"server_uuid": "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6", "name": "network-vif-plugged", "status": "completed", "tag": "45389f3c-d497-46bd-bb7e-78f6c977674a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Creating event network-vif-plugged:45389f3c-d497-46bd-bb7e-78f6c977674a for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 on user Apr 12 09:19:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Creating event network-vif-plugged:45389f3c-d497-46bd-bb7e-78f6c977674a for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 on user Apr 12 09:19:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094988 Apr 12 09:19:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 178/526] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:19:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Instance 4f211820-161b-4bef-b25d-ced137325da1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61853) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:19:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070400 Apr 12 09:19:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 177/527] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:19:47 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:47 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:47 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=9,nova_cell1:INSERT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:19:47 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:19:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:19:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:19:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:19:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:19:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039757 Apr 12 09:19:47 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 173/528] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:19:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] HTTP exception thrown: Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b could not be found. Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Request method failure captured: Apr 12 09:20:03 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b HTTP/1.1 Apr 12 09:20:03 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:20:03 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:20:03 user devstack@n-api.service[61854]: Connection: close Apr 12 09:20:03 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:20:03 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:20:03 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:20:03 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:20:03 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnXgrOR4JYesQpUc-gxUfF2Oeb4tfBclriP8a-OPiNr8OlXHhVIxv3Q8xk9xg8FvShA6i5RrFyoqzoKXV7a84gui4XO9B_yyfhHREQwryk8TPwM15Lo5COccCly54ZDWmalbvgOvNcIyjmnBGZ3WVNA3DpCEVW7OHPRzjwNq4BGYjo8 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Project-Id: 28ede6e9cdbc4b71a1affaddfd1ad9a3 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1869366097 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28ede6e9cdbc4b71a1affaddfd1ad9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28ede6e9cdbc4b71a1affaddfd1ad9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28ede6e9cdbc4b71a1affaddfd1ad9a3"}]}] Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerStableDeviceRescueTest-1869366097 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Tenant-Id: 28ede6e9cdbc4b71a1affaddfd1ad9a3 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1869366097 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-User: tempest-ServerStableDeviceRescueTest-1869366097-project-member Apr 12 09:20:03 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:20:03 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:20:03 user devstack@n-api.service[61854]: X-User-Id: d9afc908ad0e4ba9ab74006817cc0895 Apr 12 09:20:03 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerStableDeviceRescueTest-1869366097-project-member Apr 12 09:20:03 user devstack@n-api.service[61854]: method: > Apr 12 09:20:03 user devstack@n-api.service[61854]: exception: Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b could not be found. Apr 12 09:20:03 user devstack@n-api.service[61854]: action_args: {'id': '7cec0e09-36ac-43c7-9299-819b65c9da6b'} Apr 12 09:20:03 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b could not be found. Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b could not be found. Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b could not be found. Apr 12 09:20:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:20:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Returning 404 to user: Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:20:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5816d597-5269-4b39-b07f-9458be7181bb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b" status: 404 len: 111 microversion: 2.1 time: 0.042851 Apr 12 09:20:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 179/529] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:20:03 2023] GET /compute/v2.1/servers/7cec0e09-36ac-43c7-9299-819b65c9da6b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:20:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b9b3bec4-de9d-4406-85ed-0c8b4d9c7465 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Calling method '.version_select at 0x7fbd5b896e60>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b9b3bec4-de9d-4406-85ed-0c8b4d9c7465 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681767073" status: 202 len: 0 microversion: 2.1 time: 0.026721 Apr 12 09:20:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 178/530] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 09:20:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681767073 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:20:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:07 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1533143626", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "destination_type": "volume"}], "networks": [{"uuid": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:07 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] validate_networks() for [('a0210d9b-0f71-4647-9f96-c9cbe32cc3d8', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting quotas for user cc51704e74b045ad9733a43aec982390 and project a6ce4a0f4dad40c18fd8a83470c15f05. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:20:08 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:20:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.727731 Apr 12 09:20:08 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 174/531] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 09:20:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:20:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-96afe68e-5e43-4a1d-a24e-d6f94586b7db tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-96afe68e-5e43-4a1d-a24e-d6f94586b7db tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-96afe68e-5e43-4a1d-a24e-d6f94586b7db tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-96afe68e-5e43-4a1d-a24e-d6f94586b7db tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-96afe68e-5e43-4a1d-a24e-d6f94586b7db tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-96afe68e-5e43-4a1d-a24e-d6f94586b7db tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 200 len: 1395 microversion: 2.87 time: 0.087104 Apr 12 09:20:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 180/532] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:20:08 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 1395 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c878c28b-c976-4b9f-a141-649d8299a658 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 200 len: 1652 microversion: 2.20 time: 0.166106 Apr 12 09:20:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 179/533] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:20:10 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 1652 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:20:11 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Creating event network-changed:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:20:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034543 Apr 12 09:20:11 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 175/534] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:20:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cc19500d-f2c7-4002-ae4b-b3b5dde881ab tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2" status: 200 len: 1538 microversion: 2.1 time: 0.338061 Apr 12 09:20:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 181/535] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:20:12 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 => generated 1538 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:21 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f37d653c-5596-4132-8e3e-2526ed657dd2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 200 len: 1703 microversion: 2.1 time: 0.394172 Apr 12 09:20:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 180/536] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:20:21 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 1703 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:22 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:22 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-887d0592-f227-4f95-91fb-25f1fbedd412 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1721 microversion: 2.1 time: 0.171333 Apr 12 09:20:22 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 176/537] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:20:22 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:20:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:20:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232622 Apr 12 09:20:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 182/538] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:20:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:23 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0f65b5cb-24b2-4fef-aa48-1aee3854b889 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" status: 200 len: 1542 microversion: 2.1 time: 0.196776 Apr 12 09:20:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 181/539] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:20:23 2023] GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:20:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:20:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041576 Apr 12 09:20:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 177/540] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:20:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:20:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-197490685", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:35 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] validate_networks() for None {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Getting quotas for project c26312b501fe493389501c331ebbc5d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Getting quotas for user 1e26e536926043d8add1c2672f965e70 and project c26312b501fe493389501c331ebbc5d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:20:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:20:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.819623 Apr 12 09:20:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 183/541] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:20:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:20:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-23fab212-6c1b-4b80-99f3-df53be0dfe3d tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-23fab212-6c1b-4b80-99f3-df53be0dfe3d tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:36 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-23fab212-6c1b-4b80-99f3-df53be0dfe3d tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e26e536926043d8add1c2672f965e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26312b501fe493389501c331ebbc5d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-23fab212-6c1b-4b80-99f3-df53be0dfe3d tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1" status: 200 len: 1208 microversion: 2.1 time: 0.067765 Apr 12 09:20:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 182/542] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:20:36 2023] GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1 => generated 1208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:20:39 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:39 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=8 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14c316b-deba-4835-acb5-7674420fd8d1", "tag": "46d4458e-b33c-4f49-9625-e1ae1c191fb2"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Creating event network-changed:46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance c14c316b-deba-4835-acb5-7674420fd8d1 on user Apr 12 09:20:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033512 Apr 12 09:20:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 178/543] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:20:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14c316b-deba-4835-acb5-7674420fd8d1", "name": "network-vif-plugged", "status": "completed", "tag": "46d4458e-b33c-4f49-9625-e1ae1c191fb2"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Creating event network-vif-plugged:46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance c14c316b-deba-4835-acb5-7674420fd8d1 on user Apr 12 09:20:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 Apr 12 09:20:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 184/544] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:20:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:20:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14c316b-deba-4835-acb5-7674420fd8d1", "name": "network-vif-plugged", "status": "completed", "tag": "46d4458e-b33c-4f49-9625-e1ae1c191fb2"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:20:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Creating event network-vif-plugged:46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance c14c316b-deba-4835-acb5-7674420fd8d1 on user Apr 12 09:20:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039985 Apr 12 09:20:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 183/545] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:20:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:58 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:20:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-99f3388a-a590-4e6c-9850-4ba6e0134d7c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 200 len: 1769 microversion: 2.87 time: 0.156809 Apr 12 09:20:58 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 179/546] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:20:58 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 1769 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc5375ad-ca3d-4909-a1f0-42c140f9875d"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f4499557-4c31-4ce7-9742-34cb9fe03a01 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297167 Apr 12 09:21:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 185/547] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 09:21:10 2023] POST /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61853) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 09:21:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/action" status: 202 len: 0 microversion: 2.20 time: 0.186955 Apr 12 09:21:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 184/548] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:21:10 2023] POST /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:11 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-3a425d70-e764-4484-8aab-21da73aea31c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 200 len: 1738 microversion: 2.20 time: 0.151741 Apr 12 09:21:11 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 180/549] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:21:11 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e01b3058-78c7-4e2e-b062-b3b99e852006 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103817 Apr 12 09:21:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 186/550] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:21:13 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-interface => generated 283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c2cdd1-9214-4678-91a0-40fdb74403a2", "tag": "49c0392a-a4e7-4b73-af28-79c87a052cd8"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Creating event network-changed:49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 on user Apr 12 09:21:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047262 Apr 12 09:21:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 185/551] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-2fcdddd4-d08c-4c4a-83b6-5b7876121bbf tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/ips" status: 200 len: 105 microversion: 2.1 time: 0.042505 Apr 12 09:21:14 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 181/552] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:21:14 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/ips => generated 105 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9310705e-e612-4baf-92ad-00cd29fc54d1"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256317 Apr 12 09:21:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 187/553] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:21:15 2023] POST /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Creating event network-changed:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:21:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032502 Apr 12 09:21:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 186/554] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 while it is in vm_state rescued Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Request method failure captured: Apr 12 09:21:22 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments/d1961f4e-4a3f-46cc-95a2-6177a29efeb2 HTTP/1.1 Apr 12 09:21:22 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:21:22 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:21:22 user devstack@n-api.service[61855]: Connection: close Apr 12 09:21:22 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:21:22 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:21:22 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:21:22 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:21:22 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUmzpnT2cMNRisqprbMBjK9A1uBhsL4RIBULwrcb8xUYU3J1ossx8P92asSGNh52uNaEWAWU55CzY2DJliTlktGcPrAcsk2XEdOBkdHmCo1sz_NMega_JCagABoco4-yxoKPVnTz99TSp4tFLRyNDP0z2nJkU4iIAwfrhrvWynyp-Q Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Project-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}] Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Tenant: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Tenant-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:21:22 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:21:22 user devstack@n-api.service[61855]: X-User: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:21:22 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:21:22 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:21:22 user devstack@n-api.service[61855]: X-User-Id: 7f6b983634234693ba04a3097c2a129b Apr 12 09:21:22 user devstack@n-api.service[61855]: X-User-Name: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:21:22 user devstack@n-api.service[61855]: method: > Apr 12 09:21:22 user devstack@n-api.service[61855]: exception: Cannot 'detach_volume' instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 while it is in vm_state rescued Apr 12 09:21:22 user devstack@n-api.service[61855]: action_args: {'server_id': '0fe0c221-d660-4a7e-9fd8-5d9b49c659d0', 'id': 'd1961f4e-4a3f-46cc-95a2-6177a29efeb2'} Apr 12 09:21:22 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 while it is in vm_state rescued Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 while it is in vm_state rescued Apr 12 09:21:22 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Returning 409 to user: Cannot 'detach_volume' instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 while it is in vm_state rescued {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:21:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-28aea2b4-c8c0-43b7-bfc4-2bccf1f42dcc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments/d1961f4e-4a3f-46cc-95a2-6177a29efeb2" status: 409 len: 152 microversion: 2.1 time: 0.265432 Apr 12 09:21:22 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 182/555] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:21:22 2023] DELETE /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments/d1961f4e-4a3f-46cc-95a2-6177a29efeb2 => generated 152 bytes in 267 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/action" status: 202 len: 0 microversion: 2.1 time: 0.566812 Apr 12 09:21:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 188/556] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:21:22 2023] POST /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-52503050-e27a-464c-aff2-b2909643949c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1721 microversion: 2.1 time: 0.489143 Apr 12 09:21:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 187/557] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:21:22 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1721 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:23 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-651e8ef8-feb9-4fad-a7ed-538de0e44408 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 200 len: 1711 microversion: 2.1 time: 0.182312 Apr 12 09:21:23 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 183/558] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:21:23 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:21:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-60843a8c-c98c-4397-9826-08ed2753b521 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.139663 Apr 12 09:21:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 189/559] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:21:23 2023] GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/os-interface => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:23 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-01022557-0190-4b81-ae50-00820f150d48 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1721 microversion: 2.1 time: 0.259007 Apr 12 09:21:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 188/560] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:21:23 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Creating event network-vif-unplugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:21:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031555 Apr 12 09:21:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 184/561] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2bc1ed56-9874-435d-a45e-27795a988416 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/ips" status: 200 len: 107 microversion: 2.1 time: 0.069774 Apr 12 09:21:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 190/562] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:21:24 2023] GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/ips => generated 107 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85f0b6fa-1590-4f2f-a26b-e7a3e236ea86"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1ccfecbe-f5f6-4772-b60c-cbf55c7760f1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097594 Apr 12 09:21:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 189/563] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:21:24 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Invalid volume: volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 is already attached to instances: 9691009c-8aca-4347-8e46-c5bdda13aa3d Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:21:24 user devstack@n-api.service[61855]: request: POST /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/os-volume_attachments HTTP/1.1 Apr 12 09:21:24 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:21:24 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:21:24 user devstack@n-api.service[61855]: Connection: close Apr 12 09:21:24 user devstack@n-api.service[61855]: Content-Length: 74 Apr 12 09:21:24 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:21:24 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:21:24 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:21:24 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:21:24 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:21:24 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:21:24 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:21:24 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:21:24 user devstack@n-api.service[61855]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:21:24 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:21:24 user devstack@n-api.service[61855]: Apr 12 09:21:24 user devstack@n-api.service[61855]: {"volumeAttachment": {"volumeId": "85f0b6fa-1590-4f2f-a26b-e7a3e236ea86"}} Apr 12 09:21:24 user devstack@n-api.service[61855]: method: > Apr 12 09:21:24 user devstack@n-api.service[61855]: exception: Invalid volume: volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 is already attached to instances: 9691009c-8aca-4347-8e46-c5bdda13aa3d Apr 12 09:21:24 user devstack@n-api.service[61855]: action_args: {'server_id': 'dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6', 'body': {'volumeAttachment': {'volumeId': '85f0b6fa-1590-4f2f-a26b-e7a3e236ea86'}}} Apr 12 09:21:24 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 is already attached to instances: 9691009c-8aca-4347-8e46-c5bdda13aa3d Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 is already attached to instances: 9691009c-8aca-4347-8e46-c5bdda13aa3d Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 is already attached to instances: 9691009c-8aca-4347-8e46-c5bdda13aa3d Apr 12 09:21:24 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:21:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 400 to user: Invalid volume: volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 is already attached to instances: 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:21:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-1c7f7c76-6fef-4174-ba38-d5140f2e1283 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196981 Apr 12 09:21:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f3580a5e-ebfe-43f3-aa67-5755e34f0765 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/9310705e-e612-4baf-92ad-00cd29fc54d1" status: 200 len: 194 microversion: 2.1 time: 0.091556 Apr 12 09:21:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 185/564] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:21:24 2023] POST /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:21:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 191/565] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 09:21:24 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/9310705e-e612-4baf-92ad-00cd29fc54d1 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:21:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" status: 204 len: 0 microversion: 2.1 time: 0.217034 Apr 12 09:21:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 190/566] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:21:24 2023] DELETE /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:25 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:25 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-c5b54678-c1c5-4951-929e-982029577510 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" status: 200 len: 1548 microversion: 2.1 time: 0.305411 Apr 12 09:21:25 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 186/567] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:21:25 2023] GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => generated 1548 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:21:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6", "tag": "45389f3c-d497-46bd-bb7e-78f6c977674a"}, {"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}, {"server_uuid": "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6", "name": "network-vif-unplugged", "status": "completed", "tag": "45389f3c-d497-46bd-bb7e-78f6c977674a"}, {"server_uuid": "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6", "name": "network-vif-plugged", "status": "completed", "tag": "45389f3c-d497-46bd-bb7e-78f6c977674a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Creating event network-changed:45389f3c-d497-46bd-bb7e-78f6c977674a for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 on user Apr 12 09:21:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:21:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Creating event network-vif-unplugged:45389f3c-d497-46bd-bb7e-78f6c977674a for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 on user Apr 12 09:21:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Creating event network-vif-plugged:45389f3c-d497-46bd-bb7e-78f6c977674a for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 on user Apr 12 09:21:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.035459 Apr 12 09:21:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 192/568] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:26 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f901c201-bf33-4476-af4d-75ec2e081edc"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362314 Apr 12 09:21:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 191/569] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:21:26 2023] POST /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:26 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e26e536926043d8add1c2672f965e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26312b501fe493389501c331ebbc5d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:26 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b72ec554-f8f3-40e2-9940-63d4d4856347 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1" status: 200 len: 1454 microversion: 2.1 time: 0.202331 Apr 12 09:21:26 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 187/570] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:21:26 2023] GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1 => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:21:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ab3a585d-98b4-4ee1-b228-c9c7275addd4 req-7b43804f-b274-44c1-a17c-30bc20e9ff5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6", "name": "network-vif-deleted", "tag": "45389f3c-d497-46bd-bb7e-78f6c977674a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ab3a585d-98b4-4ee1-b228-c9c7275addd4 req-7b43804f-b274-44c1-a17c-30bc20e9ff5c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ab3a585d-98b4-4ee1-b228-c9c7275addd4 req-7b43804f-b274-44c1-a17c-30bc20e9ff5c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ab3a585d-98b4-4ee1-b228-c9c7275addd4 req-7b43804f-b274-44c1-a17c-30bc20e9ff5c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ab3a585d-98b4-4ee1-b228-c9c7275addd4 req-7b43804f-b274-44c1-a17c-30bc20e9ff5c service nova] Creating event network-vif-deleted:45389f3c-d497-46bd-bb7e-78f6c977674a for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 on user Apr 12 09:21:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ab3a585d-98b4-4ee1-b228-c9c7275addd4 req-7b43804f-b274-44c1-a17c-30bc20e9ff5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072923 Apr 12 09:21:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 193/571] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:21:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042022 Apr 12 09:21:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 192/572] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:21:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}, {"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}, {"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:21:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Creating event network-vif-plugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:21:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Creating event network-vif-plugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:21:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033173 Apr 12 09:21:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 188/573] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3ca08d6c-c147-42c1-bec0-6d44a7f06617 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.078460 Apr 12 09:21:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 194/574] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:21:34 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3e9926ad-1f97-46c4-9ee4-a39eea17fbeb tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/9310705e-e612-4baf-92ad-00cd29fc54d1" status: 200 len: 194 microversion: 2.1 time: 0.060101 Apr 12 09:21:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 193/575] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 09:21:34 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/9310705e-e612-4baf-92ad-00cd29fc54d1 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:34 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'services' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:21:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/9310705e-e612-4baf-92ad-00cd29fc54d1" status: 202 len: 0 microversion: 2.1 time: 0.186780 Apr 12 09:21:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 189/576] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:21:34 2023] DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/9310705e-e612-4baf-92ad-00cd29fc54d1 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1a3ab843-453d-455c-ab56-3bae6ea76dbc tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/f901c201-bf33-4476-af4d-75ec2e081edc" status: 200 len: 194 microversion: 2.1 time: 0.042640 Apr 12 09:21:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 195/577] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 09:21:37 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/f901c201-bf33-4476-af4d-75ec2e081edc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:37 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'services' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:21:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/f901c201-bf33-4476-af4d-75ec2e081edc" status: 202 len: 0 microversion: 2.1 time: 0.181871 Apr 12 09:21:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 194/578] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:21:37 2023] DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments/f901c201-bf33-4476-af4d-75ec2e081edc => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d594bb2e-a2e8-45fa-8f21-b03475f67a2e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041898 Apr 12 09:21:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 190/579] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:21:39 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-43f35863-2313-4d65-8508-46d44dd6010a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040193 Apr 12 09:21:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 196/580] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:21:39 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:21:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2" status: 204 len: 0 microversion: 2.1 time: 0.147408 Apr 12 09:21:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 195/581] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:21:39 2023] DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:40 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d91e3859-2a24-4e8a-af11-a48d1be6e7ce tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2" status: 200 len: 1663 microversion: 2.1 time: 0.199639 Apr 12 09:21:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 191/582] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:21:39 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 => generated 1663 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:21:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c2cdd1-9214-4678-91a0-40fdb74403a2", "name": "network-vif-unplugged", "status": "completed", "tag": "49c0392a-a4e7-4b73-af28-79c87a052cd8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Creating event network-vif-unplugged:49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 on user Apr 12 09:21:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041303 Apr 12 09:21:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 197/583] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:21:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c2cdd1-9214-4678-91a0-40fdb74403a2", "name": "network-vif-plugged", "status": "completed", "tag": "49c0392a-a4e7-4b73-af28-79c87a052cd8"}, {"server_uuid": "73c2cdd1-9214-4678-91a0-40fdb74403a2", "name": "network-vif-deleted", "tag": "49c0392a-a4e7-4b73-af28-79c87a052cd8"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:42 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Creating event network-vif-plugged:49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 on user Apr 12 09:21:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Creating event network-vif-deleted:49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 on user Apr 12 09:21:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035925 Apr 12 09:21:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 196/584] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=24 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "8715348a-f9cd-4895-99e4-cf9a27970818"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:58 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:59 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'flavor' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:21:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76/action" status: 200 len: 29 microversion: 2.87 time: 0.486296 Apr 12 09:21:59 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 192/585] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:21:58 2023] POST /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76/action => generated 29 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=26 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:59 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:21:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9ce2e7c9-3f42-42db-a337-9cb65fb345c7 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 200 len: 1775 microversion: 2.87 time: 0.175201 Apr 12 09:21:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 198/586] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:21:59 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 1775 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:22:00 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=3,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-unplugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Creating event network-vif-unplugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038576 Apr 12 09:22:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 197/587] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:01 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-82fbfecd-d979-449f-84df-1bd85974bed1 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 200 len: 1783 microversion: 2.20 time: 0.145707 Apr 12 09:22:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 193/588] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:22:01 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 1783 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:22:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}, {"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}, {"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}, {"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-unplugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}, {"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Creating event network-vif-unplugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035269 Apr 12 09:22:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 199/589] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030983 Apr 12 09:22:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 198/590] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:22:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Apr 12 09:22:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 194/591] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e0da7723-9083-49af-989e-fe45e852005a tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 200 len: 1717 microversion: 2.1 time: 0.138957 Apr 12 09:22:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 200/592] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:22:13 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:22:15 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 HTTP/1.1 Apr 12 09:22:15 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:22:15 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:22:15 user devstack@n-api.service[61853]: Connection: close Apr 12 09:22:15 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:22:15 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:22:15 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:22:15 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:22:15 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:22:15 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:22:15 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:22:15 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:22:15 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:22:15 user devstack@n-api.service[61853]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:22:15 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:22:15 user devstack@n-api.service[61853]: method: > Apr 12 09:22:15 user devstack@n-api.service[61853]: exception: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:22:15 user devstack@n-api.service[61853]: action_args: {'id': 'dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6'} Apr 12 09:22:15 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:22:15 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:22:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2d188b15-2b66-4420-82cc-f2b7236680de tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" status: 404 len: 111 microversion: 2.1 time: 0.038508 Apr 12 09:22:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 199/593] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:22:15 2023] GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:22:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-113449d5-8bb9-467e-8930-aa5c4de4519a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '.version_select at 0x7fbd5b8ae560>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-113449d5-8bb9-467e-8930-aa5c4de4519a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-874485369" status: 202 len: 0 microversion: 2.1 time: 0.025492 Apr 12 09:22:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 195/594] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 09:22:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-874485369 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:16 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'services' on Instance uuid 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:22:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments/85f0b6fa-1590-4f2f-a26b-e7a3e236ea86" status: 202 len: 0 microversion: 2.1 time: 0.176255 Apr 12 09:22:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 201/595] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:22:16 2023] DELETE /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments/85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-791c6e9b-29c8-43a0-a5b0-1f231228a8f2 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094702 Apr 12 09:22:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 200/596] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:22:16 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:23 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:22:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 204 len: 0 microversion: 2.1 time: 0.128855 Apr 12 09:22:23 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 196/597] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:22:23 2023] DELETE /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:24 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5a74d0e7-04fc-41a1-9a4a-ddd42012ef04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 200 len: 1727 microversion: 2.1 time: 0.249563 Apr 12 09:22:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 202/598] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:22:23 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:22:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-unplugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Creating event network-vif-unplugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:22:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033810 Apr 12 09:22:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 201/599] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-plugged", "status": "completed", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:26 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Creating event network-vif-plugged:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:22:26 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033733 Apr 12 09:22:26 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 197/600] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-5174a05d-b578-4fb7-bad4-3431b576f56b req-e194b842-95ed-4ea6-a4fd-aaaff29f47ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f211820-161b-4bef-b25d-ced137325da1", "name": "network-vif-deleted", "tag": "dc64c2a8-533c-40df-b88e-c059cb9cda89"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5174a05d-b578-4fb7-bad4-3431b576f56b req-e194b842-95ed-4ea6-a4fd-aaaff29f47ea service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5174a05d-b578-4fb7-bad4-3431b576f56b req-e194b842-95ed-4ea6-a4fd-aaaff29f47ea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5174a05d-b578-4fb7-bad4-3431b576f56b req-e194b842-95ed-4ea6-a4fd-aaaff29f47ea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-5174a05d-b578-4fb7-bad4-3431b576f56b req-e194b842-95ed-4ea6-a4fd-aaaff29f47ea service nova] Creating event network-vif-deleted:dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance 4f211820-161b-4bef-b25d-ced137325da1 on user Apr 12 09:22:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-5174a05d-b578-4fb7-bad4-3431b576f56b req-e194b842-95ed-4ea6-a4fd-aaaff29f47ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037069 Apr 12 09:22:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 203/601] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:22:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1" status: 204 len: 0 microversion: 2.1 time: 0.121596 Apr 12 09:22:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 202/602] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:22:27 2023] DELETE /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:27 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e26e536926043d8add1c2672f965e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26312b501fe493389501c331ebbc5d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:27 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-43eefd7b-3c58-4353-8b0d-2c6957c1bb00 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1" status: 200 len: 1460 microversion: 2.1 time: 0.570840 Apr 12 09:22:27 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 198/603] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:22:27 2023] GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1 => generated 1460 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:22:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14c316b-deba-4835-acb5-7674420fd8d1", "name": "network-vif-unplugged", "status": "completed", "tag": "46d4458e-b33c-4f49-9625-e1ae1c191fb2"}, {"server_uuid": "c14c316b-deba-4835-acb5-7674420fd8d1", "name": "network-vif-plugged", "status": "completed", "tag": "46d4458e-b33c-4f49-9625-e1ae1c191fb2"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Creating event network-vif-unplugged:46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance c14c316b-deba-4835-acb5-7674420fd8d1 on user Apr 12 09:22:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Creating event network-vif-plugged:46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance c14c316b-deba-4835-acb5-7674420fd8d1 on user Apr 12 09:22:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034248 Apr 12 09:22:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 204/604] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:28 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:22:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b899ccd8-74db-44fc-8774-b121ab03637c req-6ce7f315-70fb-489f-a7d2-d0a5654174f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14c316b-deba-4835-acb5-7674420fd8d1", "name": "network-vif-deleted", "tag": "46d4458e-b33c-4f49-9625-e1ae1c191fb2"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:22:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b899ccd8-74db-44fc-8774-b121ab03637c req-6ce7f315-70fb-489f-a7d2-d0a5654174f4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b899ccd8-74db-44fc-8774-b121ab03637c req-6ce7f315-70fb-489f-a7d2-d0a5654174f4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b899ccd8-74db-44fc-8774-b121ab03637c req-6ce7f315-70fb-489f-a7d2-d0a5654174f4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b899ccd8-74db-44fc-8774-b121ab03637c req-6ce7f315-70fb-489f-a7d2-d0a5654174f4 service nova] Creating event network-vif-deleted:46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance c14c316b-deba-4835-acb5-7674420fd8d1 on user Apr 12 09:22:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b899ccd8-74db-44fc-8774-b121ab03637c req-6ce7f315-70fb-489f-a7d2-d0a5654174f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038751 Apr 12 09:22:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 203/605] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:22:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HTTP exception thrown: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Request method failure captured: Apr 12 09:22:30 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 HTTP/1.1 Apr 12 09:22:30 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:22:30 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:22:30 user devstack@n-api.service[61855]: Connection: close Apr 12 09:22:30 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:22:30 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:22:30 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:22:30 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:22:30 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUf5dB1cGapqNH4ZMiB5U17GS_OsqCgOrnFNkgZhLOlm8rrDoHTBiSnDwLJuRtVVBbYS1aViNhVaQluGL_giASTARnulQ3qeeyf8V9JEPYJuPp8Dcn1j3v-4GRzBg_cswKAcgsO-GVNHx8D_ALbqXsuKHeHjJWj5TXzDxcd2VdOqZE Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Project-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}] Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Tenant-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:30 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:30 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:30 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:22:30 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:22:30 user devstack@n-api.service[61855]: X-User-Id: 2a3731bf575c44d89211709cb07060b7 Apr 12 09:22:30 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:30 user devstack@n-api.service[61855]: method: > Apr 12 09:22:30 user devstack@n-api.service[61855]: exception: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:30 user devstack@n-api.service[61855]: action_args: {'id': '73c2cdd1-9214-4678-91a0-40fdb74403a2'} Apr 12 09:22:30 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Returning 404 to user: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:22:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-7bd6a1e3-be24-4123-91ac-1ed239f5abf1 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2" status: 404 len: 111 microversion: 2.1 time: 0.031256 Apr 12 09:22:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 199/606] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:22:30 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:22:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bb476e33-f559-4caf-bd36-830ee6bd779e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '.version_select at 0x7fbd5b8735b0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bb476e33-f559-4caf-bd36-830ee6bd779e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500886200" status: 202 len: 0 microversion: 2.1 time: 0.025045 Apr 12 09:22:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 205/607] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 09:22:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500886200 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HTTP exception thrown: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Request method failure captured: Apr 12 09:22:35 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 HTTP/1.1 Apr 12 09:22:35 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:22:35 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:22:35 user devstack@n-api.service[61853]: Connection: close Apr 12 09:22:35 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:22:35 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:22:35 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:22:35 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:22:35 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUf5dB1cGapqNH4ZMiB5U17GS_OsqCgOrnFNkgZhLOlm8rrDoHTBiSnDwLJuRtVVBbYS1aViNhVaQluGL_giASTARnulQ3qeeyf8V9JEPYJuPp8Dcn1j3v-4GRzBg_cswKAcgsO-GVNHx8D_ALbqXsuKHeHjJWj5TXzDxcd2VdOqZE Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Project-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}] Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Tenant-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:35 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:35 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:35 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:22:35 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:22:35 user devstack@n-api.service[61853]: X-User-Id: 2a3731bf575c44d89211709cb07060b7 Apr 12 09:22:35 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:35 user devstack@n-api.service[61853]: method: > Apr 12 09:22:35 user devstack@n-api.service[61853]: exception: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61853]: action_args: {'id': '73c2cdd1-9214-4678-91a0-40fdb74403a2'} Apr 12 09:22:35 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Returning 404 to user: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:22:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-21f3cf9f-b155-4ade-a42b-7493030c407c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2" status: 404 len: 111 microversion: 2.1 time: 0.029332 Apr 12 09:22:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 204/608] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:22:35 2023] DELETE /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HTTP exception thrown: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Request method failure captured: Apr 12 09:22:35 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 HTTP/1.1 Apr 12 09:22:35 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:22:35 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:22:35 user devstack@n-api.service[61855]: Connection: close Apr 12 09:22:35 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:22:35 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:22:35 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:22:35 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:22:35 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUf5dB1cGapqNH4ZMiB5U17GS_OsqCgOrnFNkgZhLOlm8rrDoHTBiSnDwLJuRtVVBbYS1aViNhVaQluGL_giASTARnulQ3qeeyf8V9JEPYJuPp8Dcn1j3v-4GRzBg_cswKAcgsO-GVNHx8D_ALbqXsuKHeHjJWj5TXzDxcd2VdOqZE Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Project-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}] Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Tenant-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:35 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:35 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:35 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:22:35 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:22:35 user devstack@n-api.service[61855]: X-User-Id: 2a3731bf575c44d89211709cb07060b7 Apr 12 09:22:35 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:35 user devstack@n-api.service[61855]: method: > Apr 12 09:22:35 user devstack@n-api.service[61855]: exception: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61855]: action_args: {'id': '73c2cdd1-9214-4678-91a0-40fdb74403a2'} Apr 12 09:22:35 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. Apr 12 09:22:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:22:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Returning 404 to user: Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:22:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-91c2e582-543e-4e74-8d7e-100e082f982a tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2" status: 404 len: 111 microversion: 2.1 time: 0.034279 Apr 12 09:22:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 200/609] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:22:35 2023] GET /compute/v2.1/servers/73c2cdd1-9214-4678-91a0-40fdb74403a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HTTP exception thrown: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Request method failure captured: Apr 12 09:22:38 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 HTTP/1.1 Apr 12 09:22:38 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:22:38 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:22:38 user devstack@n-api.service[61854]: Connection: close Apr 12 09:22:38 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:22:38 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:22:38 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:22:38 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:22:38 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUf5dB1cGapqNH4ZMiB5U17GS_OsqCgOrnFNkgZhLOlm8rrDoHTBiSnDwLJuRtVVBbYS1aViNhVaQluGL_giASTARnulQ3qeeyf8V9JEPYJuPp8Dcn1j3v-4GRzBg_cswKAcgsO-GVNHx8D_ALbqXsuKHeHjJWj5TXzDxcd2VdOqZE Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Project-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}] Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Tenant-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:38 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:38 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:38 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:22:38 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:22:38 user devstack@n-api.service[61854]: X-User-Id: 2a3731bf575c44d89211709cb07060b7 Apr 12 09:22:38 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:38 user devstack@n-api.service[61854]: method: > Apr 12 09:22:38 user devstack@n-api.service[61854]: exception: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61854]: action_args: {'id': 'f683bc12-8fca-47de-b28e-a0070e77b387'} Apr 12 09:22:38 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Returning 404 to user: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:22:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-30f8247f-e82a-4f6c-a3c5-2495351cd08c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 404 len: 111 microversion: 2.1 time: 0.037586 Apr 12 09:22:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 206/610] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:22:38 2023] DELETE /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HTTP exception thrown: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Request method failure captured: Apr 12 09:22:38 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 HTTP/1.1 Apr 12 09:22:38 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:22:38 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:22:38 user devstack@n-api.service[61853]: Connection: close Apr 12 09:22:38 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:22:38 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:22:38 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:22:38 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:22:38 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUf5dB1cGapqNH4ZMiB5U17GS_OsqCgOrnFNkgZhLOlm8rrDoHTBiSnDwLJuRtVVBbYS1aViNhVaQluGL_giASTARnulQ3qeeyf8V9JEPYJuPp8Dcn1j3v-4GRzBg_cswKAcgsO-GVNHx8D_ALbqXsuKHeHjJWj5TXzDxcd2VdOqZE Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Project-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23e6ce78ce3d4eb5b4bbb307665c3670"}]}] Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Tenant-Id: 23e6ce78ce3d4eb5b4bbb307665c3670 Apr 12 09:22:38 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1252670961 Apr 12 09:22:38 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:38 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:22:38 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:22:38 user devstack@n-api.service[61853]: X-User-Id: 2a3731bf575c44d89211709cb07060b7 Apr 12 09:22:38 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeTestJSON-1252670961-project-member Apr 12 09:22:38 user devstack@n-api.service[61853]: method: > Apr 12 09:22:38 user devstack@n-api.service[61853]: exception: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61853]: action_args: {'id': 'f683bc12-8fca-47de-b28e-a0070e77b387'} Apr 12 09:22:38 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. Apr 12 09:22:38 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:22:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Returning 404 to user: Instance f683bc12-8fca-47de-b28e-a0070e77b387 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:22:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-23857143-c722-404e-b620-dfd61f4c2836 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387" status: 404 len: 111 microversion: 2.1 time: 0.032391 Apr 12 09:22:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 205/611] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:22:38 2023] GET /compute/v2.1/servers/f683bc12-8fca-47de-b28e-a0070e77b387 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:49 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:22:49 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-13237184-7d3b-4f3c-9683-6108411e1132 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 200 len: 1755 microversion: 2.87 time: 0.172188 Apr 12 09:22:49 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 201/612] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:22:49 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-113a3908-76e9-4445-a8f0-df1847e2823e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments/dc5375ad-ca3d-4909-a1f0-42c140f9875d" status: 200 len: 194 microversion: 2.20 time: 0.200052 Apr 12 09:23:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 207/613] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 09:23:01 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments/dc5375ad-ca3d-4909-a1f0-42c140f9875d => generated 194 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:02 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'services' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:23:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments/dc5375ad-ca3d-4909-a1f0-42c140f9875d" status: 202 len: 0 microversion: 2.20 time: 0.174470 Apr 12 09:23:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 206/614] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 09:23:01 2023] DELETE /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments/dc5375ad-ca3d-4909-a1f0-42c140f9875d => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:02 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-2b63fc21-187e-44f1-830b-bab3b349237b tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053399 Apr 12 09:23:02 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 202/615] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 09:23:02 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-600e1d08-ed0d-4605-878a-14216411e384 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.268139 Apr 12 09:23:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 208/616] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:23:06 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d/os-volume_attachments => generated 25 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:06 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:23:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d" status: 204 len: 0 microversion: 2.1 time: 0.111710 Apr 12 09:23:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 207/617] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:23:06 2023] DELETE /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:07 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:07 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-dfd3618c-a090-4cfa-94d0-011162df3fb9 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d" status: 200 len: 1668 microversion: 2.1 time: 0.172311 Apr 12 09:23:07 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 203/618] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:23:06 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:23:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9691009c-8aca-4347-8e46-c5bdda13aa3d", "name": "network-vif-unplugged", "status": "completed", "tag": "3fe5d678-976e-467d-888f-4575a3cc2efe"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Creating event network-vif-unplugged:3fe5d678-976e-467d-888f-4575a3cc2efe for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d on user Apr 12 09:23:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031733 Apr 12 09:23:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 209/619] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-04880061-3cd0-440b-a62d-11b8fe6a1b9c req-6eb29b5e-6e91-4d42-b065-76d28227322b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9691009c-8aca-4347-8e46-c5bdda13aa3d", "name": "network-vif-deleted", "tag": "3fe5d678-976e-467d-888f-4575a3cc2efe"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-04880061-3cd0-440b-a62d-11b8fe6a1b9c req-6eb29b5e-6e91-4d42-b065-76d28227322b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-04880061-3cd0-440b-a62d-11b8fe6a1b9c req-6eb29b5e-6e91-4d42-b065-76d28227322b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-04880061-3cd0-440b-a62d-11b8fe6a1b9c req-6eb29b5e-6e91-4d42-b065-76d28227322b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-04880061-3cd0-440b-a62d-11b8fe6a1b9c req-6eb29b5e-6e91-4d42-b065-76d28227322b service nova] Creating event network-vif-deleted:3fe5d678-976e-467d-888f-4575a3cc2efe for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d on user Apr 12 09:23:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-04880061-3cd0-440b-a62d-11b8fe6a1b9c req-6eb29b5e-6e91-4d42-b065-76d28227322b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033773 Apr 12 09:23:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 208/620] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:09 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9691009c-8aca-4347-8e46-c5bdda13aa3d", "name": "network-vif-plugged", "status": "completed", "tag": "3fe5d678-976e-467d-888f-4575a3cc2efe"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Creating event network-vif-plugged:3fe5d678-976e-467d-888f-4575a3cc2efe for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d on user Apr 12 09:23:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040248 Apr 12 09:23:09 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 204/621] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2bec5622-4d62-41e9-8c8b-b02128b38c51 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.124737 Apr 12 09:23:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 210/622] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:23:13 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-interface => generated 283 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:23:14 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 HTTP/1.1 Apr 12 09:23:14 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:23:14 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:23:14 user devstack@n-api.service[61853]: Connection: close Apr 12 09:23:14 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:23:14 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:23:14 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:23:14 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:23:14 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:23:14 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61853]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:23:14 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:23:14 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:23:14 user devstack@n-api.service[61853]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:23:14 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:23:14 user devstack@n-api.service[61853]: method: > Apr 12 09:23:14 user devstack@n-api.service[61853]: exception: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61853]: action_args: {'id': '4f211820-161b-4bef-b25d-ced137325da1'} Apr 12 09:23:14 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:23:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-89ee525f-eb49-4136-bf32-1d90bb3d573a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 404 len: 111 microversion: 2.1 time: 0.032391 Apr 12 09:23:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 209/623] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:23:14 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:23:14 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments HTTP/1.1 Apr 12 09:23:14 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:23:14 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:23:14 user devstack@n-api.service[61855]: Connection: close Apr 12 09:23:14 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:23:14 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:23:14 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:23:14 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:23:14 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:23:14 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61855]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:23:14 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:23:14 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:23:14 user devstack@n-api.service[61855]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:23:14 user devstack@n-api.service[61855]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:23:14 user devstack@n-api.service[61855]: method: > Apr 12 09:23:14 user devstack@n-api.service[61855]: exception: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61855]: action_args: {'server_id': '4f211820-161b-4bef-b25d-ced137325da1'} Apr 12 09:23:14 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:23:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-0281a041-e1f5-49b4-b60f-f5b24cf78c33 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032133 Apr 12 09:23:14 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 205/624] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:23:14 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:23:14 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 HTTP/1.1 Apr 12 09:23:14 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:23:14 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:23:14 user devstack@n-api.service[61854]: Connection: close Apr 12 09:23:14 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:23:14 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:23:14 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:23:14 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:23:14 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:23:14 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:23:14 user devstack@n-api.service[61854]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:23:14 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:23:14 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:23:14 user devstack@n-api.service[61854]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:23:14 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:23:14 user devstack@n-api.service[61854]: method: > Apr 12 09:23:14 user devstack@n-api.service[61854]: exception: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61854]: action_args: {'id': '4f211820-161b-4bef-b25d-ced137325da1'} Apr 12 09:23:14 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:23:14 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:23:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-40e55bb9-e8e4-43cb-a67a-98206c2b2e1c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 404 len: 111 microversion: 2.1 time: 0.030823 Apr 12 09:23:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 211/625] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:23:14 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-733421240", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "ba002f9e-601a-4b3a-b386-afb97d19b8c4"}], "security_groups": [{"name": "tempest-securitygroup--1613833759"}], "key_name": "tempest-keypair-184491568", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:14 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] validate_networks() for [('ba002f9e-601a-4b3a-b386-afb97d19b8c4', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:23:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Creating event network-changed:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:23:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030129 Apr 12 09:23:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 206/626] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for user 375db5b9a80244d3878822049230ba47 and project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:23:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.715950 Apr 12 09:23:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 210/627] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:23:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-50f3864c-9638-4ff6-9550-b31345035495 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:15 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-50f3864c-9638-4ff6-9550-b31345035495 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:15 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-50f3864c-9638-4ff6-9550-b31345035495 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-50f3864c-9638-4ff6-9550-b31345035495 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42" status: 200 len: 1231 microversion: 2.1 time: 0.089021 Apr 12 09:23:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 207/628] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:23:15 2023] GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42 => generated 1231 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:23:15 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'services' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:23:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments/d1961f4e-4a3f-46cc-95a2-6177a29efeb2" status: 202 len: 0 microversion: 2.1 time: 0.181846 Apr 12 09:23:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 212/629] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:23:15 2023] DELETE /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments/d1961f4e-4a3f-46cc-95a2-6177a29efeb2 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5be7f4c4-47d2-47cb-9b57-f50664fa1f4f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058913 Apr 12 09:23:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 211/630] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:23:15 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:17 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Creating event network-changed:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:23:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040844 Apr 12 09:23:17 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 208/631] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] HTTP exception thrown: Instance c14c316b-deba-4835-acb5-7674420fd8d1 could not be found. Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Request method failure captured: Apr 12 09:23:17 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1 HTTP/1.1 Apr 12 09:23:17 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:23:17 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:23:17 user devstack@n-api.service[61854]: Connection: close Apr 12 09:23:17 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:23:17 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:23:17 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:23:17 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:23:17 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnfitW_c11SXBa0Cj7dBxadPkyWRYEaklrPO_TmRPIHLL5bG8fiFeVAU39RTfkIKFM7GXxKVEUJbHBLSAdHzVvkLzlXg0KUPHI1ZtAqLq_52jS6-Bacjh67tOSDcK9dXzSbyNaslVTDcuDYgrSa80nBjwHcB11snceoSHl_utS0a2As Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Project-Id: c26312b501fe493389501c331ebbc5d0 Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesNegativeTest-1969108914 Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c26312b501fe493389501c331ebbc5d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26312b501fe493389501c331ebbc5d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26312b501fe493389501c331ebbc5d0"}]}] Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesNegativeTest-1969108914 Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Tenant-Id: c26312b501fe493389501c331ebbc5d0 Apr 12 09:23:17 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesNegativeTest-1969108914 Apr 12 09:23:17 user devstack@n-api.service[61854]: X-User: tempest-VolumesNegativeTest-1969108914-project-member Apr 12 09:23:17 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:23:17 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:23:17 user devstack@n-api.service[61854]: X-User-Id: 1e26e536926043d8add1c2672f965e70 Apr 12 09:23:17 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesNegativeTest-1969108914-project-member Apr 12 09:23:17 user devstack@n-api.service[61854]: method: > Apr 12 09:23:17 user devstack@n-api.service[61854]: exception: Instance c14c316b-deba-4835-acb5-7674420fd8d1 could not be found. Apr 12 09:23:17 user devstack@n-api.service[61854]: action_args: {'id': 'c14c316b-deba-4835-acb5-7674420fd8d1'} Apr 12 09:23:17 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14c316b-deba-4835-acb5-7674420fd8d1 could not be found. Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14c316b-deba-4835-acb5-7674420fd8d1 could not be found. Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14c316b-deba-4835-acb5-7674420fd8d1 could not be found. Apr 12 09:23:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:23:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Returning 404 to user: Instance c14c316b-deba-4835-acb5-7674420fd8d1 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:23:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6ec98f89-88d0-4ffb-9c61-2d02af01dfac tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1" status: 404 len: 111 microversion: 2.1 time: 0.036180 Apr 12 09:23:17 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 213/632] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:23:17 2023] GET /compute/v2.1/servers/c14c316b-deba-4835-acb5-7674420fd8d1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:23:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Creating event network-changed:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:23:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053357 Apr 12 09:23:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 212/633] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "name": "network-vif-plugged", "status": "completed", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Creating event network-vif-plugged:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:23:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053133 Apr 12 09:23:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 209/634] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "name": "network-vif-plugged", "status": "completed", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Creating event network-vif-plugged:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:23:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053606 Apr 12 09:23:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 214/635] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-623755002", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "a3466e34-4121-4696-b68e-404c7e7dc5a4"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] validate_networks() for [('a3466e34-4121-4696-b68e-404c7e7dc5a4', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Getting quotas for project f752416df0d043a4b82b204a780f597c. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Getting quotas for user e432c3374fe34540b47999d4cc361e0e and project f752416df0d043a4b82b204a780f597c. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:23:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:23:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.482284 Apr 12 09:23:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 213/636] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:23:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:23:36 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:36 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=18 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:36 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=22 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-5dd4144e-224d-4d52-97ba-6c66e723d5fd tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:36 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-5dd4144e-224d-4d52-97ba-6c66e723d5fd tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-5dd4144e-224d-4d52-97ba-6c66e723d5fd tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-5dd4144e-224d-4d52-97ba-6c66e723d5fd tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a" status: 200 len: 1207 microversion: 2.1 time: 0.194715 Apr 12 09:23:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 210/637] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:23:36 2023] GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a => generated 1207 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:23:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=16 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f60c685-1b91-4700-aa57-a4a272ea166a", "tag": "3e8de34b-35fa-429c-8449-262a4b6c37cd"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Creating event network-changed:3e8de34b-35fa-429c-8449-262a4b6c37cd for instance 2f60c685-1b91-4700-aa57-a4a272ea166a on user Apr 12 09:23:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047406 Apr 12 09:23:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 215/638] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f60c685-1b91-4700-aa57-a4a272ea166a", "name": "network-vif-plugged", "status": "completed", "tag": "3e8de34b-35fa-429c-8449-262a4b6c37cd"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Creating event network-vif-plugged:3e8de34b-35fa-429c-8449-262a4b6c37cd for instance 2f60c685-1b91-4700-aa57-a4a272ea166a on user Apr 12 09:23:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028832 Apr 12 09:23:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 214/639] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f60c685-1b91-4700-aa57-a4a272ea166a", "name": "network-vif-plugged", "status": "completed", "tag": "3e8de34b-35fa-429c-8449-262a4b6c37cd"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Creating event network-vif-plugged:3e8de34b-35fa-429c-8449-262a4b6c37cd for instance 2f60c685-1b91-4700-aa57-a4a272ea166a on user Apr 12 09:23:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034059 Apr 12 09:23:43 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 211/640] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76/action" status: 202 len: 0 microversion: 2.87 time: 0.076997 Apr 12 09:23:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 216/641] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:23:49 2023] POST /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:50 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0cb0d7e2-d682-41d8-a5cd-8a28b2215b6c tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 200 len: 1763 microversion: 2.87 time: 0.171878 Apr 12 09:23:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 215/642] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:23:50 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 1763 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:23:50 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:23:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-unplugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Creating event network-vif-unplugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:23:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040097 Apr 12 09:23:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 212/643] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a2aa4846-c28f-43e2-bd32-d215ce7db452 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042721 Apr 12 09:23:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 217/644] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 09:23:52 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:23:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 204 len: 0 microversion: 2.20 time: 0.128127 Apr 12 09:23:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 216/645] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:23:52 2023] DELETE /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:52 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:23:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-60e0b085-640f-47a5-9e8f-a4b63d90c501 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 200 len: 1711 microversion: 2.20 time: 0.267326 Apr 12 09:23:52 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 213/646] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:23:52 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 1711 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Creating event network-vif-unplugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:23:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039566 Apr 12 09:23:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 218/647] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}, {"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:23:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:23:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030680 Apr 12 09:23:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 217/648] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:54 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-5c76343d-72d3-48f0-a2f1-fa9c05182c48 req-0855f679-42d3-46ec-8663-b7b3d0b2f1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-deleted", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5c76343d-72d3-48f0-a2f1-fa9c05182c48 req-0855f679-42d3-46ec-8663-b7b3d0b2f1f5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5c76343d-72d3-48f0-a2f1-fa9c05182c48 req-0855f679-42d3-46ec-8663-b7b3d0b2f1f5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5c76343d-72d3-48f0-a2f1-fa9c05182c48 req-0855f679-42d3-46ec-8663-b7b3d0b2f1f5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:54 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-5c76343d-72d3-48f0-a2f1-fa9c05182c48 req-0855f679-42d3-46ec-8663-b7b3d0b2f1f5 service nova] Creating event network-vif-deleted:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:23:54 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-5c76343d-72d3-48f0-a2f1-fa9c05182c48 req-0855f679-42d3-46ec-8663-b7b3d0b2f1f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039778 Apr 12 09:23:54 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 214/649] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25232386-f51a-434b-9280-c4dd30b55f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf7a879-f705-467c-af44-2b2d40216cef"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Creating event network-vif-plugged:1cf7a879-f705-467c-af44-2b2d40216cef for instance 25232386-f51a-434b-9280-c4dd30b55f3d on user Apr 12 09:23:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031802 Apr 12 09:23:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 219/650] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:23:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028835 Apr 12 09:23:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 218/651] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:57 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:23:57 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d HTTP/1.1 Apr 12 09:23:57 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:23:57 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:23:57 user devstack@n-api.service[61855]: Connection: close Apr 12 09:23:57 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:23:57 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:23:57 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:23:57 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:23:57 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:23:57 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:23:57 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:23:57 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:23:57 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:23:57 user devstack@n-api.service[61855]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:23:57 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:23:57 user devstack@n-api.service[61855]: method: > Apr 12 09:23:57 user devstack@n-api.service[61855]: exception: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:23:57 user devstack@n-api.service[61855]: action_args: {'id': '9691009c-8aca-4347-8e46-c5bdda13aa3d'} Apr 12 09:23:57 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:23:57 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:23:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:23:57 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4337c1db-b0f6-414c-9795-6ff845c5bce5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d" status: 404 len: 111 microversion: 2.1 time: 0.030530 Apr 12 09:23:57 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 215/652] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:23:57 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:23:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4d2070f6-2539-4747-b609-c88f8d9c553e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '.version_select at 0x7fbd5b8cd900>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:23:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4d2070f6-2539-4747-b609-c88f8d9c553e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-65745046" status: 202 len: 0 microversion: 2.1 time: 0.022913 Apr 12 09:23:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 220/653] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 09:23:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-65745046 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 09:23:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0f831545-1138-44ae-9a5e-eb3968c2d117 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b8b4550>, body: {"keypair": {"name": "tempest-keypair-1087718719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQvNBBITxsZM9HuPSiY+QeZXsqErxagnjcOfJSEEh8Hxht3gNkT9m9qDL9dit5iq1Z2fJAWET+og+pU/DVCG+EfQBdzSQWdTogdyqzLzRAYHWUbY3WYrPn4HTz5OdXtDQ=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:57 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0f831545-1138-44ae-9a5e-eb3968c2d117 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:23:57 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0f831545-1138-44ae-9a5e-eb3968c2d117 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:23:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0f831545-1138-44ae-9a5e-eb3968c2d117 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046538 Apr 12 09:23:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 219/654] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:23:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-570926451", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9900741d-c340-4245-aeef-59065c45b165"}], "security_groups": [{"name": "tempest-securitygroup--1989620586"}], "key_name": "tempest-keypair-1087718719", "user_data": "}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] validate_networks() for [('9900741d-c340-4245-aeef-59065c45b165', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:23:59 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:24:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.573607 Apr 12 09:24:00 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 216/655] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:23:59 2023] POST /compute/v2.1/servers => generated 400 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:24:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4708a585-3d87-4270-a4d2-0173ddcae57c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4708a585-3d87-4270-a4d2-0173ddcae57c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-4708a585-3d87-4270-a4d2-0173ddcae57c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4708a585-3d87-4270-a4d2-0173ddcae57c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596" status: 200 len: 1235 microversion: 2.1 time: 0.079320 Apr 12 09:24:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 221/656] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:24:00 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 => generated 1235 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:24:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64edc05-fbf3-4f89-908f-ca221919c596", "tag": "1f40ed54-078b-4028-95a6-6b5788a57cad"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Creating event network-changed:1f40ed54-078b-4028-95a6-6b5788a57cad for instance d64edc05-fbf3-4f89-908f-ca221919c596 on user Apr 12 09:24:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027715 Apr 12 09:24:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 220/657] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:04 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64edc05-fbf3-4f89-908f-ca221919c596", "name": "network-vif-plugged", "status": "completed", "tag": "1f40ed54-078b-4028-95a6-6b5788a57cad"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Creating event network-vif-plugged:1f40ed54-078b-4028-95a6-6b5788a57cad for instance d64edc05-fbf3-4f89-908f-ca221919c596 on user Apr 12 09:24:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047942 Apr 12 09:24:04 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 217/658] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-497c98ef-a828-477c-adff-616b1115e3d7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42" status: 200 len: 1538 microversion: 2.1 time: 0.168357 Apr 12 09:24:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 222/659] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:24:05 2023] GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42 => generated 1538 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:24:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b8befe5e-95b2-4107-aeeb-18f07a3ea510 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045136 Apr 12 09:24:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 221/660] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:24:05 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:24:05 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 204 len: 0 microversion: 2.1 time: 0.123257 Apr 12 09:24:05 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 218/661] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:24:05 2023] DELETE /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:05 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-92758413-0021-49a0-9c25-f5a13bc94d9b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 200 len: 1677 microversion: 2.1 time: 0.256827 Apr 12 09:24:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 223/662] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:24:05 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:24:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Creating event network-vif-unplugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:24:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057278 Apr 12 09:24:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 222/663] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64edc05-fbf3-4f89-908f-ca221919c596", "name": "network-vif-plugged", "status": "completed", "tag": "1f40ed54-078b-4028-95a6-6b5788a57cad"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Creating event network-vif-plugged:1f40ed54-078b-4028-95a6-6b5788a57cad for instance d64edc05-fbf3-4f89-908f-ca221919c596 on user Apr 12 09:24:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039246 Apr 12 09:24:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 219/664] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-deleted", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:08 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] Creating event network-vif-deleted:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:24:08 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035661 Apr 12 09:24:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 224/665] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:08 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Creating event network-vif-plugged:a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 on user Apr 12 09:24:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040482 Apr 12 09:24:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 223/666] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:27 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:27 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-390fbf8c-b6bd-4de2-ac9c-535551158db0 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a" status: 200 len: 1485 microversion: 2.1 time: 0.199470 Apr 12 09:24:27 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 220/667] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:24:27 2023] GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a => generated 1485 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d902f54e-28d2-4bd1-9495-678585f45a50 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 200 len: 1769 microversion: 2.87 time: 0.233120 Apr 12 09:24:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 225/668] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:24:40 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 1769 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] HTTP exception thrown: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Request method failure captured: Apr 12 09:24:42 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d HTTP/1.1 Apr 12 09:24:42 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:24:42 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:24:42 user devstack@n-api.service[61853]: Connection: close Apr 12 09:24:42 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:24:42 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:24:42 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:24:42 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:24:42 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnciUq20yHAuU8QtTsFZHu6R5hueRwO5GQrU4eTcOqxZ2CF8DwSbbdgvAwj5kjpN3WvGFkIphABB5p0jl66SkiR3sv6Ot4ai2htJRDqajE1gOWOw1eUikks7ZFsAB6iR4XdekDWeb95wNFS_EfmwYSpx5MuNXVW9KCYpoZhzmpztg6E Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Project-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}] Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Tenant-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:24:42 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:24:42 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:24:42 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:24:42 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:24:42 user devstack@n-api.service[61853]: X-User-Id: d76daece06a943668e6c1c3c2c57ebaa Apr 12 09:24:42 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:24:42 user devstack@n-api.service[61853]: method: > Apr 12 09:24:42 user devstack@n-api.service[61853]: exception: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:24:42 user devstack@n-api.service[61853]: action_args: {'id': '25232386-f51a-434b-9280-c4dd30b55f3d'} Apr 12 09:24:42 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:24:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Returning 404 to user: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:24:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9dbc3a52-f590-444c-95e8-74f8f3f8f5b5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 404 len: 111 microversion: 2.20 time: 0.035716 Apr 12 09:24:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 224/669] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:24:42 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:24:42 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1da06d5a-6881-4014-a138-dfb6277f68cb tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '.version_select at 0x7fbd5b9d7f40>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:42 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:42 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-1da06d5a-6881-4014-a138-dfb6277f68cb tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501602451" status: 204 len: 0 microversion: 2.20 time: 0.027370 Apr 12 09:24:42 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 221/670] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 09:24:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501602451 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:24:43 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-89bf814f-e51f-4d27-9d1b-f0945ae614f5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b872d40>, body: {"keypair": {"name": "tempest-keypair-202654117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5L2YPZ2KVlhG6oFOZGGwTxHh7VmuiAaOSH0We/vpq8fOiO1mNYzg6+tMndipazXRpul18uCeRgGch/My5l++MyiqK2qEK0kNajHsUhulUGdS/XiM9WXRLjaM3kVzoxA=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:43 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-89bf814f-e51f-4d27-9d1b-f0945ae614f5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:24:43 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-89bf814f-e51f-4d27-9d1b-f0945ae614f5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for user d76daece06a943668e6c1c3c2c57ebaa and project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:24:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-89bf814f-e51f-4d27-9d1b-f0945ae614f5 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045359 Apr 12 09:24:43 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 226/671] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 09:24:43 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-368249722", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1da53f15-1745-4e97-beac-302695973f1f"}], "security_groups": [{"name": "tempest-securitygroup--646690245"}], "key_name": "tempest-keypair-202654117", "user_data": "}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] validate_networks() for [('1da53f15-1745-4e97-beac-302695973f1f', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting quotas for user d76daece06a943668e6c1c3c2c57ebaa and project 6ebfa64bb5194b859821a77de6805d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:24:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:24:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.682172 Apr 12 09:24:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 225/672] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 09:24:45 2023] POST /compute/v2.1/servers => generated 399 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 09:24:45 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a6fcd873-de5b-4cd0-9004-0f8dba043bfc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:45 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a6fcd873-de5b-4cd0-9004-0f8dba043bfc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:46 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-a6fcd873-de5b-4cd0-9004-0f8dba043bfc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:46 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-a6fcd873-de5b-4cd0-9004-0f8dba043bfc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:46 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-a6fcd873-de5b-4cd0-9004-0f8dba043bfc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a6fcd873-de5b-4cd0-9004-0f8dba043bfc tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 200 len: 1274 microversion: 2.20 time: 0.065480 Apr 12 09:24:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 222/673] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:24:45 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 1274 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:24:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Creating event network-changed:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:24:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086874 Apr 12 09:24:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 227/674] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:50 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:24:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-90a3dda8-12ac-4aa8-8428-ed2ba6e8c084 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596" status: 200 len: 1545 microversion: 2.1 time: 0.198279 Apr 12 09:24:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 226/675] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:24:50 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 => generated 1545 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:24:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-plugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Creating event network-vif-plugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:24:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100520 Apr 12 09:24:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 223/676] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-plugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:24:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Creating event network-vif-plugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:24:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028936 Apr 12 09:24:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 228/677] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:24:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] HTTP exception thrown: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 could not be found. Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Request method failure captured: Apr 12 09:24:56 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 HTTP/1.1 Apr 12 09:24:56 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:24:56 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:24:56 user devstack@n-api.service[61853]: Connection: close Apr 12 09:24:56 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:24:56 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:24:56 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:24:56 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:24:56 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUmzpnT2cMNRisqprbMBjK9A1uBhsL4RIBULwrcb8xUYU3J1ossx8P92asSGNh52uNaEWAWU55CzY2DJliTlktGcPrAcsk2XEdOBkdHmCo1sz_NMega_JCagABoco4-yxoKPVnTz99TSp4tFLRyNDP0z2nJkU4iIAwfrhrvWynyp-Q Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Project-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}] Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Tenant-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:24:56 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:24:56 user devstack@n-api.service[61853]: X-User: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:24:56 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:24:56 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:24:56 user devstack@n-api.service[61853]: X-User-Id: 7f6b983634234693ba04a3097c2a129b Apr 12 09:24:56 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:24:56 user devstack@n-api.service[61853]: method: > Apr 12 09:24:56 user devstack@n-api.service[61853]: exception: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 could not be found. Apr 12 09:24:56 user devstack@n-api.service[61853]: action_args: {'id': '0fe0c221-d660-4a7e-9fd8-5d9b49c659d0'} Apr 12 09:24:56 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 could not be found. Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 could not be found. Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 could not be found. Apr 12 09:24:56 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:24:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Returning 404 to user: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:24:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d7c81e7b-40b0-45e6-8fc9-da6ce22202e9 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" status: 404 len: 111 microversion: 2.1 time: 0.032603 Apr 12 09:24:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 227/678] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:24:56 2023] GET /compute/v2.1/servers/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:24:56 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:24:56 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-9563478b-2289-42ed-bcb3-1cb6c2185e61 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '.version_select at 0x7fbd5b8aee60>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:24:56 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-9563478b-2289-42ed-bcb3-1cb6c2185e61 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774942187" status: 202 len: 0 microversion: 2.1 time: 0.026188 Apr 12 09:24:56 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 224/679] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 09:24:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774942187 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:25:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8" status: 204 len: 0 microversion: 2.1 time: 0.138976 Apr 12 09:25:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 229/680] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:25:01 2023] DELETE /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:01 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-77f12f1d-f827-43e6-b215-d573066d7c43 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8" status: 200 len: 1495 microversion: 2.1 time: 0.168816 Apr 12 09:25:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 228/681] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:25:01 2023] GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 => generated 1495 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:25:01 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-unplugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Creating event network-vif-unplugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:25:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039671 Apr 12 09:25:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 225/682] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-deleted", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] Creating event network-vif-deleted:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:25:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029180 Apr 12 09:25:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 230/683] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f58bf6a-beec-40e5-b8be-de03539038f8", "name": "network-vif-plugged", "status": "completed", "tag": "44c4d894-3c30-4528-95cd-37f612257156"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Creating event network-vif-plugged:44c4d894-3c30-4528-95cd-37f612257156 for instance 6f58bf6a-beec-40e5-b8be-de03539038f8 on user Apr 12 09:25:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Apr 12 09:25:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 229/684] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:05 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-dc57dfbf-ba4b-49aa-a3b0-82d0b9dfaa18 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.178768 Apr 12 09:25:05 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 226/685] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:25:05 2023] GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42/os-interface => generated 283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Creating event network-changed:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:25:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028262 Apr 12 09:25:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 231/686] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-310903129", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "ba002f9e-601a-4b3a-b386-afb97d19b8c4"}], "security_groups": [{"name": "tempest-securitygroup--1613833759"}], "key_name": "tempest-keypair-184491568", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "da73130e-1f1c-40e7-9961-d5b661f114a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] validate_networks() for [('ba002f9e-601a-4b3a-b386-afb97d19b8c4', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for user 375db5b9a80244d3878822049230ba47 and project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:25:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da73130e-1f1c-40e7-9961-d5b661f114a2',volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:25:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.688902 Apr 12 09:25:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 230/687] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:25:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:25:09 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-fb5e6a0e-9ea4-40b8-9add-a9b59acc1694 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:09 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-fb5e6a0e-9ea4-40b8-9add-a9b59acc1694 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:09 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-fb5e6a0e-9ea4-40b8-9add-a9b59acc1694 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-fb5e6a0e-9ea4-40b8-9add-a9b59acc1694 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1074 microversion: 2.1 time: 0.063431 Apr 12 09:25:09 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 227/688] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:25:09 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1074 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:25:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:12 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:12 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Creating event network-changed:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:25:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033106 Apr 12 09:25:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 232/689] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-plugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=24 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Creating event network-vif-plugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:25:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040085 Apr 12 09:25:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 231/690] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-plugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Creating event network-vif-plugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:25:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039092 Apr 12 09:25:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 228/691] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:27 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:25:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a" status: 204 len: 0 microversion: 2.1 time: 0.120755 Apr 12 09:25:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 233/692] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:25:27 2023] DELETE /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-bf091c6e-2d87-4899-a343-7a091cd9fb5f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a" status: 200 len: 1491 microversion: 2.1 time: 0.167814 Apr 12 09:25:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 232/693] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:25:27 2023] GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a => generated 1491 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:25:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f60c685-1b91-4700-aa57-a4a272ea166a", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8de34b-35fa-429c-8449-262a4b6c37cd"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Creating event network-vif-unplugged:3e8de34b-35fa-429c-8449-262a4b6c37cd for instance 2f60c685-1b91-4700-aa57-a4a272ea166a on user Apr 12 09:25:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115593 Apr 12 09:25:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 229/694] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f60c685-1b91-4700-aa57-a4a272ea166a", "name": "network-vif-deleted", "tag": "3e8de34b-35fa-429c-8449-262a4b6c37cd"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] Creating event network-vif-deleted:3e8de34b-35fa-429c-8449-262a4b6c37cd for instance 2f60c685-1b91-4700-aa57-a4a272ea166a on user Apr 12 09:25:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Apr 12 09:25:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 234/695] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f60c685-1b91-4700-aa57-a4a272ea166a", "name": "network-vif-plugged", "status": "completed", "tag": "3e8de34b-35fa-429c-8449-262a4b6c37cd"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Creating event network-vif-plugged:3e8de34b-35fa-429c-8449-262a4b6c37cd for instance 2f60c685-1b91-4700-aa57-a4a272ea166a on user Apr 12 09:25:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032662 Apr 12 09:25:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 233/696] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-6b1a38d4-57d4-4aee-a9b0-307852ae922c tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 200 len: 1585 microversion: 2.20 time: 0.157859 Apr 12 09:25:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 230/697] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:25:36 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 1585 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:25:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 204 len: 0 microversion: 2.87 time: 0.262197 Apr 12 09:25:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 235/698] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:25:40 2023] DELETE /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=9 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:40 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-unplugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2c8bc604-3f9c-4496-b89f-772205e35fba tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 200 len: 1775 microversion: 2.87 time: 0.201056 Apr 12 09:25:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 234/699] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:25:40 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 1775 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:25:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Creating event network-vif-unplugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:25:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032660 Apr 12 09:25:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 231/700] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-deleted", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] Creating event network-vif-deleted:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:25:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030827 Apr 12 09:25:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 236/701] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825afa91-cf8c-477a-afbf-40af95b81c76", "name": "network-vif-plugged", "status": "completed", "tag": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Creating event network-vif-plugged:99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance 825afa91-cf8c-477a-afbf-40af95b81c76 on user Apr 12 09:25:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028981 Apr 12 09:25:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 235/702] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-c31f90b1-88e1-441a-9938-631461763d8b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.094610 Apr 12 09:25:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 232/703] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:25:50 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64edc05-fbf3-4f89-908f-ca221919c596", "tag": "1f40ed54-078b-4028-95a6-6b5788a57cad"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Creating event network-changed:1f40ed54-078b-4028-95a6-6b5788a57cad for instance d64edc05-fbf3-4f89-908f-ca221919c596 on user Apr 12 09:25:51 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032472 Apr 12 09:25:51 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 237/704] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2ebcc66c-71ec-4a6e-9dc7-954a6e87d6c3 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/ips" status: 200 len: 108 microversion: 2.1 time: 0.038787 Apr 12 09:25:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 236/705] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:25:51 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/ips => generated 108 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=11 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=17 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:25:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] HTTP exception thrown: Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 could not be found. Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Request method failure captured: Apr 12 09:25:51 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 HTTP/1.1 Apr 12 09:25:51 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:25:51 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:25:51 user devstack@n-api.service[61855]: Connection: close Apr 12 09:25:51 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:25:51 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:25:51 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:25:51 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:25:51 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUmzpnT2cMNRisqprbMBjK9A1uBhsL4RIBULwrcb8xUYU3J1ossx8P92asSGNh52uNaEWAWU55CzY2DJliTlktGcPrAcsk2XEdOBkdHmCo1sz_NMega_JCagABoco4-yxoKPVnTz99TSp4tFLRyNDP0z2nJkU4iIAwfrhrvWynyp-Q Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Project-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}] Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Tenant: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Tenant-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:25:51 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:25:51 user devstack@n-api.service[61855]: X-User: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:25:51 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:25:51 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:25:51 user devstack@n-api.service[61855]: X-User-Id: 7f6b983634234693ba04a3097c2a129b Apr 12 09:25:51 user devstack@n-api.service[61855]: X-User-Name: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:25:51 user devstack@n-api.service[61855]: method: > Apr 12 09:25:51 user devstack@n-api.service[61855]: exception: Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 could not be found. Apr 12 09:25:51 user devstack@n-api.service[61855]: action_args: {'id': '6f58bf6a-beec-40e5-b8be-de03539038f8'} Apr 12 09:25:51 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 could not be found. Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 could not be found. Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 could not be found. Apr 12 09:25:51 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:25:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Returning 404 to user: Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:25:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f94e099a-b420-431c-adc3-bc3b10860ecb tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8" status: 404 len: 111 microversion: 2.1 time: 0.144618 Apr 12 09:25:51 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 233/706] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:25:51 2023] GET /compute/v2.1/servers/6f58bf6a-beec-40e5-b8be-de03539038f8 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:25:51 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 204 len: 0 microversion: 2.1 time: 0.122520 Apr 12 09:25:51 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 238/707] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:25:51 2023] DELETE /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:25:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5846e1fa-fefd-4bb3-8f70-10e908bf63cc tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 200 len: 1510 microversion: 2.1 time: 0.177552 Apr 12 09:25:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 237/708] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:25:51 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:25:52 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-unplugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Creating event network-vif-unplugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:25:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078871 Apr 12 09:25:52 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 234/709] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d299f12-59f6-4fcc-8780-8edb75277242"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258802 Apr 12 09:25:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 239/710] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:25:52 2023] POST /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-deleted", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] Creating event network-vif-deleted:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:25:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Apr 12 09:25:53 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 238/711] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:54 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a835849-83a7-457d-a96d-0acaa5a4a964", "name": "network-vif-plugged", "status": "completed", "tag": "a9c92ca6-773e-40e3-ab31-710b4b495183"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:54 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Creating event network-vif-plugged:a9c92ca6-773e-40e3-ab31-710b4b495183 for instance 4a835849-83a7-457d-a96d-0acaa5a4a964 on user Apr 12 09:25:54 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031653 Apr 12 09:25:54 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 235/712] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:25:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d299f12-59f6-4fcc-8780-8edb75277242"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Invalid volume: volume 0d299f12-59f6-4fcc-8780-8edb75277242 is already attached to instances: d64edc05-fbf3-4f89-908f-ca221919c596 Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:25:59 user devstack@n-api.service[61854]: request: POST /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments HTTP/1.1 Apr 12 09:25:59 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:25:59 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:25:59 user devstack@n-api.service[61854]: Connection: close Apr 12 09:25:59 user devstack@n-api.service[61854]: Content-Length: 74 Apr 12 09:25:59 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:25:59 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:25:59 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:25:59 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:25:59 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:25:59 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:25:59 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:25:59 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:25:59 user devstack@n-api.service[61854]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:25:59 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:25:59 user devstack@n-api.service[61854]: Apr 12 09:25:59 user devstack@n-api.service[61854]: {"volumeAttachment": {"volumeId": "0d299f12-59f6-4fcc-8780-8edb75277242"}} Apr 12 09:25:59 user devstack@n-api.service[61854]: method: > Apr 12 09:25:59 user devstack@n-api.service[61854]: exception: Invalid volume: volume 0d299f12-59f6-4fcc-8780-8edb75277242 is already attached to instances: d64edc05-fbf3-4f89-908f-ca221919c596 Apr 12 09:25:59 user devstack@n-api.service[61854]: action_args: {'server_id': 'd64edc05-fbf3-4f89-908f-ca221919c596', 'body': {'volumeAttachment': {'volumeId': '0d299f12-59f6-4fcc-8780-8edb75277242'}}} Apr 12 09:25:59 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d299f12-59f6-4fcc-8780-8edb75277242 is already attached to instances: d64edc05-fbf3-4f89-908f-ca221919c596 Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d299f12-59f6-4fcc-8780-8edb75277242 is already attached to instances: d64edc05-fbf3-4f89-908f-ca221919c596 Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d299f12-59f6-4fcc-8780-8edb75277242 is already attached to instances: d64edc05-fbf3-4f89-908f-ca221919c596 Apr 12 09:25:59 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:25:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 400 to user: Invalid volume: volume 0d299f12-59f6-4fcc-8780-8edb75277242 is already attached to instances: d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:25:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b9e058b6-91d4-4273-bfc6-d0a673ceaf27 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093937 Apr 12 09:25:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 240/713] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:25:59 2023] POST /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:59 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'services' on Instance uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:25:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments/0d299f12-59f6-4fcc-8780-8edb75277242" status: 202 len: 0 microversion: 2.1 time: 0.156094 Apr 12 09:25:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 239/714] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:25:59 2023] DELETE /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments/0d299f12-59f6-4fcc-8780-8edb75277242 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:25:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:25:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-7a0ad647-c0fb-4cae-87a7-2b83d3abea86 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056958 Apr 12 09:25:59 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 236/715] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:25:59 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-14180769-b49e-4309-9076-ffc48c05b268 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1427 microversion: 2.1 time: 0.152079 Apr 12 09:26:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 241/716] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:26:00 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=14 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] HTTP exception thrown: Instance 2f60c685-1b91-4700-aa57-a4a272ea166a could not be found. Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Request method failure captured: Apr 12 09:26:18 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a HTTP/1.1 Apr 12 09:26:18 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:26:18 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:26:18 user devstack@n-api.service[61853]: Connection: close Apr 12 09:26:18 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:26:18 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:26:18 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:26:18 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:26:18 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNniWjdOpHbTaTLIF5ohSJzF2MXCzPAWuviqAccqnGh6WPgbAsYC4vbJ57TZBxptpnpbO_QRwBVLCfZpPFIDjtiznphWj_6gg98HMUEIn-bkzR6Y_k-iDkFk8TmjWGC81ShXA3_Pi4x1CMl9OvEdLvb1p7_kg2m0q5yS7ssFlpg8kuXQ Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Project-Id: f752416df0d043a4b82b204a780f597c Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesActionsTest-902475152 Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f752416df0d043a4b82b204a780f597c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f752416df0d043a4b82b204a780f597c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f752416df0d043a4b82b204a780f597c"}]}] Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesActionsTest-902475152 Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Tenant-Id: f752416df0d043a4b82b204a780f597c Apr 12 09:26:18 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesActionsTest-902475152 Apr 12 09:26:18 user devstack@n-api.service[61853]: X-User: tempest-VolumesActionsTest-902475152-project-member Apr 12 09:26:18 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:26:18 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:26:18 user devstack@n-api.service[61853]: X-User-Id: e432c3374fe34540b47999d4cc361e0e Apr 12 09:26:18 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesActionsTest-902475152-project-member Apr 12 09:26:18 user devstack@n-api.service[61853]: method: > Apr 12 09:26:18 user devstack@n-api.service[61853]: exception: Instance 2f60c685-1b91-4700-aa57-a4a272ea166a could not be found. Apr 12 09:26:18 user devstack@n-api.service[61853]: action_args: {'id': '2f60c685-1b91-4700-aa57-a4a272ea166a'} Apr 12 09:26:18 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f60c685-1b91-4700-aa57-a4a272ea166a could not be found. Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f60c685-1b91-4700-aa57-a4a272ea166a could not be found. Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f60c685-1b91-4700-aa57-a4a272ea166a could not be found. Apr 12 09:26:18 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Returning 404 to user: Instance 2f60c685-1b91-4700-aa57-a4a272ea166a could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:26:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8a9efce2-ead9-4a2a-b4d4-5a69f0f585c4 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a" status: 404 len: 111 microversion: 2.1 time: 0.035954 Apr 12 09:26:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 240/717] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:26:18 2023] GET /compute/v2.1/servers/2f60c685-1b91-4700-aa57-a4a272ea166a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1709160961", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "a3466e34-4121-4696-b68e-404c7e7dc5a4"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=7 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=11 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] validate_networks() for [('a3466e34-4121-4696-b68e-404c7e7dc5a4', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Getting quotas for project f752416df0d043a4b82b204a780f597c. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Getting quotas for user e432c3374fe34540b47999d4cc361e0e and project f752416df0d043a4b82b204a780f597c. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:26:18 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:26:18 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.572508 Apr 12 09:26:18 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 237/718] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:26:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:26:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a812dbab-2b36-4390-a36f-f6bdc7499e1f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a812dbab-2b36-4390-a36f-f6bdc7499e1f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a812dbab-2b36-4390-a36f-f6bdc7499e1f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a812dbab-2b36-4390-a36f-f6bdc7499e1f tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc" status: 200 len: 1208 microversion: 2.1 time: 0.070596 Apr 12 09:26:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 242/719] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:26:18 2023] GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc => generated 1208 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:26:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "767f53f6-4a39-4ba7-ba02-105344e5c6fc", "tag": "69806c5e-19dc-4012-b62c-133ad94c3800"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Creating event network-changed:69806c5e-19dc-4012-b62c-133ad94c3800 for instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc on user Apr 12 09:26:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029991 Apr 12 09:26:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 241/720] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:23 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767f53f6-4a39-4ba7-ba02-105344e5c6fc", "name": "network-vif-plugged", "status": "completed", "tag": "69806c5e-19dc-4012-b62c-133ad94c3800"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Creating event network-vif-plugged:69806c5e-19dc-4012-b62c-133ad94c3800 for instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc on user Apr 12 09:26:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030755 Apr 12 09:26:23 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 238/721] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767f53f6-4a39-4ba7-ba02-105344e5c6fc", "name": "network-vif-plugged", "status": "completed", "tag": "69806c5e-19dc-4012-b62c-133ad94c3800"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Creating event network-vif-plugged:69806c5e-19dc-4012-b62c-133ad94c3800 for instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc on user Apr 12 09:26:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036649 Apr 12 09:26:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 243/722] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HTTP exception thrown: Instance 825afa91-cf8c-477a-afbf-40af95b81c76 could not be found. Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Request method failure captured: Apr 12 09:26:31 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 HTTP/1.1 Apr 12 09:26:31 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:26:31 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:26:31 user devstack@n-api.service[61853]: Connection: close Apr 12 09:26:31 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:26:31 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:26:31 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:26:31 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:26:31 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUUA706-_BVSwmQMrj0OtPIUPNZCbmN4-sLC_9Wi2tJDtSDOwDxkEgf-w0GyJ8vFY8lShuB14P-IBLVsxCJxV0kbgubD1mNnaYoRasknLo_IdZVvozzfplXyiajQD8SpZ06Q9sxACtM8cYuJmtrgLbzKYwJcSGmTLVCfyfNwJIEHEI Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Project-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}] Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Tenant-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:26:31 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:26:31 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:26:31 user devstack@n-api.service[61853]: X-User-Id: cc51704e74b045ad9733a43aec982390 Apr 12 09:26:31 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:26:31 user devstack@n-api.service[61853]: method: > Apr 12 09:26:31 user devstack@n-api.service[61853]: exception: Instance 825afa91-cf8c-477a-afbf-40af95b81c76 could not be found. Apr 12 09:26:31 user devstack@n-api.service[61853]: action_args: {'id': '825afa91-cf8c-477a-afbf-40af95b81c76'} Apr 12 09:26:31 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825afa91-cf8c-477a-afbf-40af95b81c76 could not be found. Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825afa91-cf8c-477a-afbf-40af95b81c76 could not be found. Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825afa91-cf8c-477a-afbf-40af95b81c76 could not be found. Apr 12 09:26:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Returning 404 to user: Instance 825afa91-cf8c-477a-afbf-40af95b81c76 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:26:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7e6d6954-cbe3-4eb2-81af-3efd7a201ccc tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76" status: 404 len: 111 microversion: 2.87 time: 0.031827 Apr 12 09:26:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 242/723] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:26:31 2023] GET /compute/v2.1/servers/825afa91-cf8c-477a-afbf-40af95b81c76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:26:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef" status: 204 len: 0 microversion: 2.87 time: 0.130252 Apr 12 09:26:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 239/724] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:26:31 2023] DELETE /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-92bd96e7-c8aa-4f55-973f-d9e6dcdd4d64 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef" status: 200 len: 1697 microversion: 2.87 time: 0.254820 Apr 12 09:26:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 244/725] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:26:31 2023] GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef => generated 1697 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e442604c-86f4-45e1-9407-1764133852ef", "name": "network-vif-unplugged", "status": "completed", "tag": "c456f016-a187-4f16-9a25-2ae020e10413"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Creating event network-vif-unplugged:c456f016-a187-4f16-9a25-2ae020e10413 for instance e442604c-86f4-45e1-9407-1764133852ef on user Apr 12 09:26:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043191 Apr 12 09:26:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 243/726] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b7be2ee9-4e50-4a8b-925a-7399da022ede req-f9250d85-996c-415b-8af2-d4498befbc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e442604c-86f4-45e1-9407-1764133852ef", "name": "network-vif-deleted", "tag": "c456f016-a187-4f16-9a25-2ae020e10413"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b7be2ee9-4e50-4a8b-925a-7399da022ede req-f9250d85-996c-415b-8af2-d4498befbc45 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b7be2ee9-4e50-4a8b-925a-7399da022ede req-f9250d85-996c-415b-8af2-d4498befbc45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b7be2ee9-4e50-4a8b-925a-7399da022ede req-f9250d85-996c-415b-8af2-d4498befbc45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b7be2ee9-4e50-4a8b-925a-7399da022ede req-f9250d85-996c-415b-8af2-d4498befbc45 service nova] Creating event network-vif-deleted:c456f016-a187-4f16-9a25-2ae020e10413 for instance e442604c-86f4-45e1-9407-1764133852ef on user Apr 12 09:26:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b7be2ee9-4e50-4a8b-925a-7399da022ede req-f9250d85-996c-415b-8af2-d4498befbc45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031527 Apr 12 09:26:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 240/727] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e442604c-86f4-45e1-9407-1764133852ef", "name": "network-vif-plugged", "status": "completed", "tag": "c456f016-a187-4f16-9a25-2ae020e10413"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Creating event network-vif-plugged:c456f016-a187-4f16-9a25-2ae020e10413 for instance e442604c-86f4-45e1-9407-1764133852ef on user Apr 12 09:26:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029619 Apr 12 09:26:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 245/728] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b843544d-e24a-4c60-8003-5b7e692a6ed9 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.088698 Apr 12 09:26:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 244/729] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 09:26:36 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-interface => generated 282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:26:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Creating event network-changed:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:26:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031811 Apr 12 09:26:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 241/730] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f8e232ab-38dc-4a1d-978e-b66523edbcf3 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/ips" status: 200 len: 110 microversion: 2.20 time: 0.035037 Apr 12 09:26:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 246/731] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 09:26:37 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/ips => generated 110 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:39 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'flavor' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:26:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/action" status: 202 len: 0 microversion: 2.20 time: 0.741835 Apr 12 09:26:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 245/732] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:26:39 2023] POST /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:40 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:40 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:40 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-775e91ea-c4a9-4cc3-a882-1992050c9453 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 200 len: 1710 microversion: 2.20 time: 0.211077 Apr 12 09:26:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 242/733] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:26:39 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 1710 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:26:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-unplugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Creating event network-vif-unplugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:26:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030091 Apr 12 09:26:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 247/734] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] HTTP exception thrown: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 could not be found. Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Request method failure captured: Apr 12 09:26:42 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 HTTP/1.1 Apr 12 09:26:42 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:26:42 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:26:42 user devstack@n-api.service[61853]: Connection: close Apr 12 09:26:42 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:26:42 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:26:42 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:26:42 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:26:42 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUmzpnT2cMNRisqprbMBjK9A1uBhsL4RIBULwrcb8xUYU3J1ossx8P92asSGNh52uNaEWAWU55CzY2DJliTlktGcPrAcsk2XEdOBkdHmCo1sz_NMega_JCagABoco4-yxoKPVnTz99TSp4tFLRyNDP0z2nJkU4iIAwfrhrvWynyp-Q Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Project-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c3cc8ab6ab244b1badb6fea347d64ea"}]}] Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Tenant-Id: 1c3cc8ab6ab244b1badb6fea347d64ea Apr 12 09:26:42 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-480181232 Apr 12 09:26:42 user devstack@n-api.service[61853]: X-User: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:26:42 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:26:42 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:26:42 user devstack@n-api.service[61853]: X-User-Id: 7f6b983634234693ba04a3097c2a129b Apr 12 09:26:42 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerRescueNegativeTestJSON-480181232-project-member Apr 12 09:26:42 user devstack@n-api.service[61853]: method: > Apr 12 09:26:42 user devstack@n-api.service[61853]: exception: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 could not be found. Apr 12 09:26:42 user devstack@n-api.service[61853]: action_args: {'id': '4a835849-83a7-457d-a96d-0acaa5a4a964'} Apr 12 09:26:42 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 could not be found. Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 could not be found. Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 could not be found. Apr 12 09:26:42 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:26:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Returning 404 to user: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:26:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8e7c17c0-49a9-4f97-8486-b9a7c30d66ec tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964" status: 404 len: 111 microversion: 2.1 time: 0.028477 Apr 12 09:26:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 246/735] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:26:42 2023] GET /compute/v2.1/servers/4a835849-83a7-457d-a96d-0acaa5a4a964 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:26:42 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-plugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Creating event network-vif-plugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:26:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Apr 12 09:26:42 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 243/736] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Creating event network-changed:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:26:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040641 Apr 12 09:26:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 248/737] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=15 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7a34a511-9f1c-4120-9429-361208342d30 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050304 Apr 12 09:26:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 247/738] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:26:49 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:49 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:26:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596" status: 204 len: 0 microversion: 2.1 time: 0.136075 Apr 12 09:26:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 244/739] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:26:49 2023] DELETE /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=19 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=19 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:26:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64edc05-fbf3-4f89-908f-ca221919c596", "name": "network-vif-unplugged", "status": "completed", "tag": "1f40ed54-078b-4028-95a6-6b5788a57cad"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Creating event network-vif-unplugged:1f40ed54-078b-4028-95a6-6b5788a57cad for instance d64edc05-fbf3-4f89-908f-ca221919c596 on user Apr 12 09:26:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030939 Apr 12 09:26:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 248/740] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:50 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7b24c508-a74f-4247-8068-4ebe1ccbe3eb tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596" status: 200 len: 1670 microversion: 2.1 time: 0.507015 Apr 12 09:26:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 249/741] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:26:50 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 => generated 1670 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:26:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64edc05-fbf3-4f89-908f-ca221919c596", "name": "network-vif-deleted", "tag": "1f40ed54-078b-4028-95a6-6b5788a57cad"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] Creating event network-vif-deleted:1f40ed54-078b-4028-95a6-6b5788a57cad for instance d64edc05-fbf3-4f89-908f-ca221919c596 on user Apr 12 09:26:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032235 Apr 12 09:26:51 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 245/742] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64edc05-fbf3-4f89-908f-ca221919c596", "name": "network-vif-plugged", "status": "completed", "tag": "1f40ed54-078b-4028-95a6-6b5788a57cad"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Creating event network-vif-plugged:1f40ed54-078b-4028-95a6-6b5788a57cad for instance d64edc05-fbf3-4f89-908f-ca221919c596 on user Apr 12 09:26:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127403 Apr 12 09:26:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 249/743] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-323240227", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "bbc0bb34-7666-4c19-b2a4-d272ba7af767"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:53 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] validate_networks() for [('bbc0bb34-7666-4c19-b2a4-d272ba7af767', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Getting quotas for project dcea1b997ee6450dbf603305d2812f7f. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Getting quotas for user 741e227a2cc7425d8b171c2a04989191 and project dcea1b997ee6450dbf603305d2812f7f. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:26:54 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:26:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.728468 Apr 12 09:26:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 250/744] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:26:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:26:54 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-c256e6a8-1faa-408f-95c3-e63df963152c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:26:54 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-c256e6a8-1faa-408f-95c3-e63df963152c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:26:54 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-c256e6a8-1faa-408f-95c3-e63df963152c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:26:54 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-c256e6a8-1faa-408f-95c3-e63df963152c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 200 len: 1210 microversion: 2.1 time: 0.065543 Apr 12 09:26:54 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 246/745] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:26:54 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 1210 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:26:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ed5717-a2c5-469a-b1c8-2577b4debc2f", "tag": "267e3243-9c0f-454c-a691-ee2d1f4fcddf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Creating event network-changed:267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f on user Apr 12 09:26:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033241 Apr 12 09:26:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 250/746] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:26:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ed5717-a2c5-469a-b1c8-2577b4debc2f", "name": "network-vif-plugged", "status": "completed", "tag": "267e3243-9c0f-454c-a691-ee2d1f4fcddf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:26:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:26:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:26:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:26:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Creating event network-vif-plugged:267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f on user Apr 12 09:26:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028515 Apr 12 09:26:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 251/747] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:26:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d0195e67-ab3d-42a9-ab95-9266ad8efc04 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.092838 Apr 12 09:27:00 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 247/748] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:27:00 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/os-interface => generated 283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ed5717-a2c5-469a-b1c8-2577b4debc2f", "name": "network-vif-plugged", "status": "completed", "tag": "267e3243-9c0f-454c-a691-ee2d1f4fcddf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Creating event network-vif-plugged:267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f on user Apr 12 09:27:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 Apr 12 09:27:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 251/749] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f733c813-4f6c-4cce-8efa-349f11d7ef27 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1427 microversion: 2.1 time: 0.156020 Apr 12 09:27:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 252/750] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:27:01 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Old instance type m1.nano, new instance type m1.micro {{(pid=61855) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting quotas for user 375db5b9a80244d3878822049230ba47 and project 20b8c89c46bb460f9f94be9426a22bb8. Resources: {'cores', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:27:01 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:27:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/action" status: 202 len: 0 microversion: 2.1 time: 0.163890 Apr 12 09:27:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 248/751] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:27:01 2023] POST /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:01 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f4099f9a-236a-4c16-a141-4fc6423ce53a tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1436 microversion: 2.1 time: 0.164792 Apr 12 09:27:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 252/752] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:27:01 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1436 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:27:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}, {"name": "network-changed", "server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Creating event network-changed:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:27:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Creating event network-changed:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:27:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61854) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:27:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042536 Apr 12 09:27:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 253/753] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:03 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:04 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:04 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-unplugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Creating event network-vif-unplugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:27:04 user devstack@n-api.service[61855]: DEBUG nova.compute.api [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61855) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:27:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041250 Apr 12 09:27:04 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 249/754] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-plugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Creating event network-vif-plugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:27:06 user devstack@n-api.service[61853]: DEBUG nova.compute.api [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61853) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:27:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053201 Apr 12 09:27:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 253/755] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2ecf7330-4269-4638-9d89-65eeac5d0e72 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc" status: 200 len: 1486 microversion: 2.1 time: 0.168336 Apr 12 09:27:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 254/756] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:27:08 2023] GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc => generated 1486 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-plugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Creating event network-vif-plugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:27:15 user devstack@n-api.service[61855]: DEBUG nova.compute.api [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61855) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:27:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050409 Apr 12 09:27:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 250/757] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=13 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=23 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-plugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Creating event network-vif-plugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:27:17 user devstack@n-api.service[61853]: DEBUG nova.compute.api [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61853) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 09:27:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041045 Apr 12 09:27:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 254/758] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=25 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HTTP exception thrown: Instance e442604c-86f4-45e1-9407-1764133852ef could not be found. Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Request method failure captured: Apr 12 09:27:21 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef HTTP/1.1 Apr 12 09:27:21 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:27:21 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:27:21 user devstack@n-api.service[61854]: Connection: close Apr 12 09:27:21 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:27:21 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:27:21 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:27:21 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:27:21 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUUA706-_BVSwmQMrj0OtPIUPNZCbmN4-sLC_9Wi2tJDtSDOwDxkEgf-w0GyJ8vFY8lShuB14P-IBLVsxCJxV0kbgubD1mNnaYoRasknLo_IdZVvozzfplXyiajQD8SpZ06Q9sxACtM8cYuJmtrgLbzKYwJcSGmTLVCfyfNwJIEHEI Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Project-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}] Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Tenant-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:27:21 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:27:21 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:27:21 user devstack@n-api.service[61854]: X-User-Id: cc51704e74b045ad9733a43aec982390 Apr 12 09:27:21 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:27:21 user devstack@n-api.service[61854]: method: > Apr 12 09:27:21 user devstack@n-api.service[61854]: exception: Instance e442604c-86f4-45e1-9407-1764133852ef could not be found. Apr 12 09:27:21 user devstack@n-api.service[61854]: action_args: {'id': 'e442604c-86f4-45e1-9407-1764133852ef'} Apr 12 09:27:21 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e442604c-86f4-45e1-9407-1764133852ef could not be found. Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e442604c-86f4-45e1-9407-1764133852ef could not be found. Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e442604c-86f4-45e1-9407-1764133852ef could not be found. Apr 12 09:27:21 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:27:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Returning 404 to user: Instance e442604c-86f4-45e1-9407-1764133852ef could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:27:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-88425f83-f946-42dc-8ebc-0046a2b5f2a5 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef" status: 404 len: 111 microversion: 2.87 time: 0.033665 Apr 12 09:27:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 255/759] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:27:21 2023] GET /compute/v2.1/servers/e442604c-86f4-45e1-9407-1764133852ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:21 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:27:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 204 len: 0 microversion: 2.87 time: 0.110242 Apr 12 09:27:21 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 251/760] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:27:21 2023] DELETE /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:22 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:22 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:22 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1d8109d7-bfa8-4f35-bc28-65073031d8e8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 200 len: 1776 microversion: 2.87 time: 0.214094 Apr 12 09:27:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 255/761] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:27:21 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 1776 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:27:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-unplugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Creating event network-vif-unplugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:27:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031509 Apr 12 09:27:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 256/762] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:23 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-95e717a6-e729-4aab-a06f-32bd8ee81e6f req-5be6d78e-42f0-486f-b418-c79f13dbb7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-deleted", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-95e717a6-e729-4aab-a06f-32bd8ee81e6f req-5be6d78e-42f0-486f-b418-c79f13dbb7d9 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-95e717a6-e729-4aab-a06f-32bd8ee81e6f req-5be6d78e-42f0-486f-b418-c79f13dbb7d9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:23 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-95e717a6-e729-4aab-a06f-32bd8ee81e6f req-5be6d78e-42f0-486f-b418-c79f13dbb7d9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-95e717a6-e729-4aab-a06f-32bd8ee81e6f req-5be6d78e-42f0-486f-b418-c79f13dbb7d9 service nova] Creating event network-vif-deleted:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:27:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-95e717a6-e729-4aab-a06f-32bd8ee81e6f req-5be6d78e-42f0-486f-b418-c79f13dbb7d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028797 Apr 12 09:27:23 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 252/763] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2070294-eb8a-4ee9-a4b5-baab508d8744", "name": "network-vif-plugged", "status": "completed", "tag": "2c417659-5031-44dd-9796-062033960cc6"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Creating event network-vif-plugged:2c417659-5031-44dd-9796-062033960cc6 for instance e2070294-eb8a-4ee9-a4b5-baab508d8744 on user Apr 12 09:27:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027245 Apr 12 09:27:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 256/764] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:30 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-05c8d16d-bc4b-4e69-895a-57eef98f25b2 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 200 len: 1651 microversion: 2.20 time: 0.215702 Apr 12 09:27:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 257/765] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:27:30 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 1651 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:27:40 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 HTTP/1.1 Apr 12 09:27:40 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:27:40 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:27:40 user devstack@n-api.service[61855]: Connection: close Apr 12 09:27:40 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:27:40 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:27:40 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:27:40 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:27:40 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:27:40 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:27:40 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:27:40 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:27:40 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:27:40 user devstack@n-api.service[61855]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:27:40 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:27:40 user devstack@n-api.service[61855]: method: > Apr 12 09:27:40 user devstack@n-api.service[61855]: exception: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:27:40 user devstack@n-api.service[61855]: action_args: {'id': 'd64edc05-fbf3-4f89-908f-ca221919c596'} Apr 12 09:27:40 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:27:40 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:27:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:27:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a92071bb-d303-4bae-8f2e-ecfa2f3fe414 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596" status: 404 len: 111 microversion: 2.1 time: 0.037431 Apr 12 09:27:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 253/766] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:27:40 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:27:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-17c8b00c-20f2-4028-9398-0f3724e22825 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '.version_select at 0x7fbd5b754430>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-17c8b00c-20f2-4028-9398-0f3724e22825 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087718719" status: 202 len: 0 microversion: 2.1 time: 0.028969 Apr 12 09:27:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 257/767] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 09:27:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087718719 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:27:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3bd18b4c-e1e0-484d-b65b-02d6ca7d2755 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b870c10>, body: {"keypair": {"name": "tempest-keypair-362915146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmqL/RA2rC1kBm3Ff5KrAftAjrvhWNZ/OQ5TDfV9dAC2Ccj/MoRUsFjeZcGQJBlDG6A617ip4RQTAT5Ukp1cISoHXEaXM5g0tGPnH9lEp7FMv/jSMqDy+I7uQrZBLhWyg=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:27:41 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-3bd18b4c-e1e0-484d-b65b-02d6ca7d2755 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:27:41 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-3bd18b4c-e1e0-484d-b65b-02d6ca7d2755 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:27:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3bd18b4c-e1e0-484d-b65b-02d6ca7d2755 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051602 Apr 12 09:27:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 258/768] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:27:41 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2062565541", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9900741d-c340-4245-aeef-59065c45b165"}], "security_groups": [{"name": "tempest-securitygroup--1398288006"}], "key_name": "tempest-keypair-362915146", "user_data": "}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:43 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] validate_networks() for [('9900741d-c340-4245-aeef-59065c45b165', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting quotas for user 5f91fed06f9547d29125f38fe2d47221 and project 37b4beaf457f4120bcbcd2b033d5c3db. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:27:44 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:27:44 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.535321 Apr 12 09:27:44 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 254/769] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:27:43 2023] POST /compute/v2.1/servers => generated 400 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:27:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9d5e4d85-f90f-4d94-90c0-f751e5a53f6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:44 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9d5e4d85-f90f-4d94-90c0-f751e5a53f6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:44 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-9d5e4d85-f90f-4d94-90c0-f751e5a53f6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9d5e4d85-f90f-4d94-90c0-f751e5a53f6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223" status: 200 len: 1235 microversion: 2.1 time: 0.068310 Apr 12 09:27:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 258/770] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:27:44 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 => generated 1235 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:44 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1328fdaf-aca2-41ab-8503-24eedfe09c27 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 200 len: 1494 microversion: 2.1 time: 0.140683 Apr 12 09:27:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 259/771] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:27:44 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 1494 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:27:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Creating event network-changed:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:27:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028996 Apr 12 09:27:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 255/772] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-plugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Creating event network-vif-plugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:27:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Apr 12 09:27:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 259/773] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-plugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:27:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Creating event network-vif-plugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:27:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031513 Apr 12 09:27:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 260/774] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:27:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:27:51 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:27:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a2c19bfb-48e3-4ebc-a283-549fbd0a6072 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1553 microversion: 2.1 time: 0.174211 Apr 12 09:27:51 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 256/775] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:27:51 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:28:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc" status: 204 len: 0 microversion: 2.1 time: 0.126942 Apr 12 09:28:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 260/776] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:28:09 2023] DELETE /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:10 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7c9a63cf-cb17-4b8e-b6cd-bfbb797d0b95 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc" status: 200 len: 1492 microversion: 2.1 time: 0.187005 Apr 12 09:28:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 261/777] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:28:09 2023] GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc => generated 1492 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767f53f6-4a39-4ba7-ba02-105344e5c6fc", "name": "network-vif-unplugged", "status": "completed", "tag": "69806c5e-19dc-4012-b62c-133ad94c3800"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=12 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:10 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Creating event network-vif-unplugged:69806c5e-19dc-4012-b62c-133ad94c3800 for instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc on user Apr 12 09:28:10 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040058 Apr 12 09:28:10 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 257/778] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767f53f6-4a39-4ba7-ba02-105344e5c6fc", "name": "network-vif-plugged", "status": "completed", "tag": "69806c5e-19dc-4012-b62c-133ad94c3800"}, {"server_uuid": "767f53f6-4a39-4ba7-ba02-105344e5c6fc", "name": "network-vif-deleted", "tag": "69806c5e-19dc-4012-b62c-133ad94c3800"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Creating event network-vif-plugged:69806c5e-19dc-4012-b62c-133ad94c3800 for instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc on user Apr 12 09:28:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Creating event network-vif-deleted:69806c5e-19dc-4012-b62c-133ad94c3800 for instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc on user Apr 12 09:28:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034489 Apr 12 09:28:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 261/779] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HTTP exception thrown: Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 could not be found. Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Request method failure captured: Apr 12 09:28:12 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 HTTP/1.1 Apr 12 09:28:12 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:28:12 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:28:12 user devstack@n-api.service[61854]: Connection: close Apr 12 09:28:12 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:28:12 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:28:12 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:28:12 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:28:12 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUUA706-_BVSwmQMrj0OtPIUPNZCbmN4-sLC_9Wi2tJDtSDOwDxkEgf-w0GyJ8vFY8lShuB14P-IBLVsxCJxV0kbgubD1mNnaYoRasknLo_IdZVvozzfplXyiajQD8SpZ06Q9sxACtM8cYuJmtrgLbzKYwJcSGmTLVCfyfNwJIEHEI Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Project-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}] Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Tenant-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:28:12 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:28:12 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:28:12 user devstack@n-api.service[61854]: X-User-Id: cc51704e74b045ad9733a43aec982390 Apr 12 09:28:12 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:28:12 user devstack@n-api.service[61854]: method: > Apr 12 09:28:12 user devstack@n-api.service[61854]: exception: Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 could not be found. Apr 12 09:28:12 user devstack@n-api.service[61854]: action_args: {'id': 'e2070294-eb8a-4ee9-a4b5-baab508d8744'} Apr 12 09:28:12 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 could not be found. Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 could not be found. Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 could not be found. Apr 12 09:28:12 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Returning 404 to user: Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:28:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5cb948d0-41f0-4cde-af59-823d2819a3af tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744" status: 404 len: 111 microversion: 2.87 time: 0.035448 Apr 12 09:28:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 262/780] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:28:12 2023] GET /compute/v2.1/servers/e2070294-eb8a-4ee9-a4b5-baab508d8744 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:28:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281" status: 204 len: 0 microversion: 2.87 time: 0.113687 Apr 12 09:28:12 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 258/781] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:28:12 2023] DELETE /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:12 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6959180a-437b-4b65-9aa5-f828ff6e7124 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281" status: 200 len: 1697 microversion: 2.87 time: 0.224544 Apr 12 09:28:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 262/782] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:28:12 2023] GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a569c652-6b15-4244-b011-1d09fbdd4281", "name": "network-vif-unplugged", "status": "completed", "tag": "b2a3049a-cc8d-4804-854e-2451b7f886fd"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Creating event network-vif-unplugged:b2a3049a-cc8d-4804-854e-2451b7f886fd for instance a569c652-6b15-4244-b011-1d09fbdd4281 on user Apr 12 09:28:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029668 Apr 12 09:28:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 263/783] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:14 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-6d4e4647-d5fe-4679-a37a-2b023741ed26 req-02ea813e-b7f6-4390-ae12-620b052da552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a569c652-6b15-4244-b011-1d09fbdd4281", "name": "network-vif-deleted", "tag": "b2a3049a-cc8d-4804-854e-2451b7f886fd"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6d4e4647-d5fe-4679-a37a-2b023741ed26 req-02ea813e-b7f6-4390-ae12-620b052da552 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6d4e4647-d5fe-4679-a37a-2b023741ed26 req-02ea813e-b7f6-4390-ae12-620b052da552 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:14 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-6d4e4647-d5fe-4679-a37a-2b023741ed26 req-02ea813e-b7f6-4390-ae12-620b052da552 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-6d4e4647-d5fe-4679-a37a-2b023741ed26 req-02ea813e-b7f6-4390-ae12-620b052da552 service nova] Creating event network-vif-deleted:b2a3049a-cc8d-4804-854e-2451b7f886fd for instance a569c652-6b15-4244-b011-1d09fbdd4281 on user Apr 12 09:28:14 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-6d4e4647-d5fe-4679-a37a-2b023741ed26 req-02ea813e-b7f6-4390-ae12-620b052da552 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029714 Apr 12 09:28:14 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 259/784] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a569c652-6b15-4244-b011-1d09fbdd4281", "name": "network-vif-plugged", "status": "completed", "tag": "b2a3049a-cc8d-4804-854e-2451b7f886fd"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Creating event network-vif-plugged:b2a3049a-cc8d-4804-854e-2451b7f886fd for instance a569c652-6b15-4244-b011-1d09fbdd4281 on user Apr 12 09:28:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028821 Apr 12 09:28:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 263/785] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c8aea0c-8fb2-4169-9d29-6ad53da833bd"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a3f7bb62-8523-480f-a498-b87cdf34bad7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.439531 Apr 12 09:28:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 264/786] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 09:28:30 2023] POST /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-volume_attachments => generated 188 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-62ae84a0-60b8-4747-b1b5-206c38d707ef tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-volume_attachments/5c8aea0c-8fb2-4169-9d29-6ad53da833bd" status: 202 len: 0 microversion: 2.20 time: 0.247491 Apr 12 09:28:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 260/787] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 09:28:30 2023] DELETE /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-volume_attachments/5c8aea0c-8fb2-4169-9d29-6ad53da833bd => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61853) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 09:28:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/action" status: 202 len: 0 microversion: 2.20 time: 0.106612 Apr 12 09:28:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 264/788] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 09:28:31 2023] POST /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-68cc777f-35f2-4dc9-aaa8-b87fcc044113 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 200 len: 1659 microversion: 2.20 time: 0.145689 Apr 12 09:28:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 265/789] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:28:31 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 1659 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:28:33 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:33 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:33 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Creating event network-changed:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:28:33 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031159 Apr 12 09:28:33 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 261/790] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:34 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e7776739-74b9-42b5-92b8-1f6aa947dbb5 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223" status: 200 len: 1544 microversion: 2.1 time: 0.216568 Apr 12 09:28:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 265/791] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:28:34 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 => generated 1544 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:28:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-plugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Creating event network-vif-plugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:28:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032443 Apr 12 09:28:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 266/792] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:41 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-plugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:41 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Creating event network-vif-plugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:28:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029056 Apr 12 09:28:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 262/793] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2004437417", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "bbc0bb34-7666-4c19-b2a4-d272ba7af767"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] validate_networks() for [('bbc0bb34-7666-4c19-b2a4-d272ba7af767', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:45 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Getting quotas for project dcea1b997ee6450dbf603305d2812f7f. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:28:45 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Getting quotas for user 741e227a2cc7425d8b171c2a04989191 and project dcea1b997ee6450dbf603305d2812f7f. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:28:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:28:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:28:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.490026 Apr 12 09:28:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 266/794] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:28:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 09:28:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d47bf44f-3d90-4303-acea-11b728039017 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d47bf44f-3d90-4303-acea-11b728039017 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:45 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-d47bf44f-3d90-4303-acea-11b728039017 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d47bf44f-3d90-4303-acea-11b728039017 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c" status: 200 len: 1211 microversion: 2.1 time: 0.095981 Apr 12 09:28:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 267/795] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:28:45 2023] GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:28:47 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57fc5db7-8577-4a55-a511-d9f25db0a43c", "tag": "10aaf934-db80-40bb-9b6c-464151693b9c"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Creating event network-changed:10aaf934-db80-40bb-9b6c-464151693b9c for instance 57fc5db7-8577-4a55-a511-d9f25db0a43c on user Apr 12 09:28:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032868 Apr 12 09:28:47 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 263/796] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fc5db7-8577-4a55-a511-d9f25db0a43c", "name": "network-vif-plugged", "status": "completed", "tag": "10aaf934-db80-40bb-9b6c-464151693b9c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Creating event network-vif-plugged:10aaf934-db80-40bb-9b6c-464151693b9c for instance 57fc5db7-8577-4a55-a511-d9f25db0a43c on user Apr 12 09:28:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048550 Apr 12 09:28:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 267/797] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:51 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fc5db7-8577-4a55-a511-d9f25db0a43c", "name": "network-vif-plugged", "status": "completed", "tag": "10aaf934-db80-40bb-9b6c-464151693b9c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:51 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:28:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:51 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Creating event network-vif-plugged:10aaf934-db80-40bb-9b6c-464151693b9c for instance 57fc5db7-8577-4a55-a511-d9f25db0a43c on user Apr 12 09:28:51 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032732 Apr 12 09:28:51 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 268/798] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:28:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/action" status: 204 len: 0 microversion: 2.1 time: 0.071170 Apr 12 09:28:52 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 264/799] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:28:52 2023] POST /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:28:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:28:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-363ce79c-0004-49e6-b2a5-212626b174e8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1553 microversion: 2.1 time: 0.165371 Apr 12 09:28:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 268/800] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:28:52 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] HTTP exception thrown: Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc could not be found. Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Request method failure captured: Apr 12 09:29:00 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc HTTP/1.1 Apr 12 09:29:00 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:29:00 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:29:00 user devstack@n-api.service[61854]: Connection: close Apr 12 09:29:00 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:29:00 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:29:00 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:29:00 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:29:00 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNniWjdOpHbTaTLIF5ohSJzF2MXCzPAWuviqAccqnGh6WPgbAsYC4vbJ57TZBxptpnpbO_QRwBVLCfZpPFIDjtiznphWj_6gg98HMUEIn-bkzR6Y_k-iDkFk8TmjWGC81ShXA3_Pi4x1CMl9OvEdLvb1p7_kg2m0q5yS7ssFlpg8kuXQ Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Project-Id: f752416df0d043a4b82b204a780f597c Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesActionsTest-902475152 Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f752416df0d043a4b82b204a780f597c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f752416df0d043a4b82b204a780f597c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f752416df0d043a4b82b204a780f597c"}]}] Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesActionsTest-902475152 Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Tenant-Id: f752416df0d043a4b82b204a780f597c Apr 12 09:29:00 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesActionsTest-902475152 Apr 12 09:29:00 user devstack@n-api.service[61854]: X-User: tempest-VolumesActionsTest-902475152-project-member Apr 12 09:29:00 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:29:00 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:29:00 user devstack@n-api.service[61854]: X-User-Id: e432c3374fe34540b47999d4cc361e0e Apr 12 09:29:00 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesActionsTest-902475152-project-member Apr 12 09:29:00 user devstack@n-api.service[61854]: method: > Apr 12 09:29:00 user devstack@n-api.service[61854]: exception: Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc could not be found. Apr 12 09:29:00 user devstack@n-api.service[61854]: action_args: {'id': '767f53f6-4a39-4ba7-ba02-105344e5c6fc'} Apr 12 09:29:00 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc could not be found. Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc could not be found. Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc could not be found. Apr 12 09:29:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:29:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Returning 404 to user: Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:29:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8a16424a-4a0a-4ad2-9c11-4c2264b6fa55 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc" status: 404 len: 111 microversion: 2.1 time: 0.155815 Apr 12 09:29:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 269/801] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:29:00 2023] GET /compute/v2.1/servers/767f53f6-4a39-4ba7-ba02-105344e5c6fc => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:02 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HTTP exception thrown: Instance a569c652-6b15-4244-b011-1d09fbdd4281 could not be found. Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Request method failure captured: Apr 12 09:29:02 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281 HTTP/1.1 Apr 12 09:29:02 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:29:02 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:29:02 user devstack@n-api.service[61855]: Connection: close Apr 12 09:29:02 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:29:02 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:29:02 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:29:02 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:29:02 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUUA706-_BVSwmQMrj0OtPIUPNZCbmN4-sLC_9Wi2tJDtSDOwDxkEgf-w0GyJ8vFY8lShuB14P-IBLVsxCJxV0kbgubD1mNnaYoRasknLo_IdZVvozzfplXyiajQD8SpZ06Q9sxACtM8cYuJmtrgLbzKYwJcSGmTLVCfyfNwJIEHEI Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Project-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6ce4a0f4dad40c18fd8a83470c15f05"}]}] Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Tenant-Id: a6ce4a0f4dad40c18fd8a83470c15f05 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:29:02 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:29:02 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:29:02 user devstack@n-api.service[61855]: X-User-Id: cc51704e74b045ad9733a43aec982390 Apr 12 09:29:02 user devstack@n-api.service[61855]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member Apr 12 09:29:02 user devstack@n-api.service[61855]: method: > Apr 12 09:29:02 user devstack@n-api.service[61855]: exception: Instance a569c652-6b15-4244-b011-1d09fbdd4281 could not be found. Apr 12 09:29:02 user devstack@n-api.service[61855]: action_args: {'id': 'a569c652-6b15-4244-b011-1d09fbdd4281'} Apr 12 09:29:02 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a569c652-6b15-4244-b011-1d09fbdd4281 could not be found. Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a569c652-6b15-4244-b011-1d09fbdd4281 could not be found. Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a569c652-6b15-4244-b011-1d09fbdd4281 could not be found. Apr 12 09:29:02 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:29:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Returning 404 to user: Instance a569c652-6b15-4244-b011-1d09fbdd4281 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:29:02 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-18ae1de7-e5e5-4199-a61b-622c48aafbb4 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281" status: 404 len: 111 microversion: 2.87 time: 0.039795 Apr 12 09:29:02 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 265/802] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:29:02 2023] GET /compute/v2.1/servers/a569c652-6b15-4244-b011-1d09fbdd4281 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:29:21 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:29:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-63a5794d-d043-467d-89dc-5f533d74d38e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 200 len: 1704 microversion: 2.20 time: 0.290337 Apr 12 09:29:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 269/803] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:29:21 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 1704 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1664cd6d-12e7-4927-a522-61526b6a62ad tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.094654 Apr 12 09:29:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 270/804] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 09:29:34 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:29:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:29:35 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:29:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-46f67ca5-3b90-4c75-8d63-fe78805e3f7e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c" status: 200 len: 1495 microversion: 2.1 time: 0.528337 Apr 12 09:29:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 266/805] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:29:35 2023] GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c => generated 1495 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:29:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Creating event network-changed:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:29:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125619 Apr 12 09:29:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 270/806] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:29:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-87f2ef97-68ca-4c03-98d9-31724c5641ec tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/ips" status: 200 len: 107 microversion: 2.1 time: 0.036676 Apr 12 09:29:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 271/807] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:29:35 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/ips => generated 107 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "151e2c1a-196e-4e20-af6f-76ebb0f3ed9c"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:37 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294830 Apr 12 09:29:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 267/808] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:29:37 2023] POST /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:42 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:29:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-110b6a6c-5a71-4382-8031-931e7d2d056d tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1545 microversion: 2.1 time: 0.184742 Apr 12 09:29:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 271/809] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:29:42 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1545 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:45 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'services' on Instance uuid a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:29:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments/151e2c1a-196e-4e20-af6f-76ebb0f3ed9c" status: 202 len: 0 microversion: 2.1 time: 0.262215 Apr 12 09:29:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 272/810] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:29:45 2023] DELETE /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments/151e2c1a-196e-4e20-af6f-76ebb0f3ed9c => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:29:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:29:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d458327c-5d42-4bc0-a452-73980fe1c119 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050982 Apr 12 09:29:45 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 268/811] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:29:45 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-910217585", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "2624d977-6b5d-49b6-85b5-16ffb1c9dfc7", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "04d87eab-eb0c-4ca0-b654-941b5fb8be90"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:12 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] validate_networks() for [('04d87eab-eb0c-4ca0-b654-941b5fb8be90', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for user 4d3fba65a6ff4e73addd3ec6cdbb08cf and project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:30:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2624d977-6b5d-49b6-85b5-16ffb1c9dfc7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:30:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.124000 Apr 12 09:30:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 272/812] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:30:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:30:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8575bd71-07e1-4ae6-9455-96de6f9efb23 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8575bd71-07e1-4ae6-9455-96de6f9efb23 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-8575bd71-07e1-4ae6-9455-96de6f9efb23 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8575bd71-07e1-4ae6-9455-96de6f9efb23 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 200 len: 1051 microversion: 2.1 time: 0.091049 Apr 12 09:30:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 273/813] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:30:13 2023] GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 1051 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:30:16 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:16 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:16 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7", "tag": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:16 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Creating event network-changed:ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 on user Apr 12 09:30:16 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205769 Apr 12 09:30:16 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 269/814] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5b338e42-43de-47f5-b127-abb9a777dca7 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041158 Apr 12 09:30:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 273/815] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 09:30:22 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:30:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 204 len: 0 microversion: 2.20 time: 0.118357 Apr 12 09:30:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 274/816] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:30:22 2023] DELETE /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:22 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:22 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-758446ff-da0b-44dc-a285-ec5129f21840 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 200 len: 1710 microversion: 2.20 time: 0.187532 Apr 12 09:30:22 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 270/817] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:30:22 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 1710 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-unplugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Creating event network-vif-unplugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:30:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087965 Apr 12 09:30:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 274/818] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-874d9349-da0b-4a15-99ff-fc7e51e70f6b req-0d4e1b7f-e567-4a9e-b2d2-ac24b3c528c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-deleted", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-874d9349-da0b-4a15-99ff-fc7e51e70f6b req-0d4e1b7f-e567-4a9e-b2d2-ac24b3c528c1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-874d9349-da0b-4a15-99ff-fc7e51e70f6b req-0d4e1b7f-e567-4a9e-b2d2-ac24b3c528c1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-874d9349-da0b-4a15-99ff-fc7e51e70f6b req-0d4e1b7f-e567-4a9e-b2d2-ac24b3c528c1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-874d9349-da0b-4a15-99ff-fc7e51e70f6b req-0d4e1b7f-e567-4a9e-b2d2-ac24b3c528c1 service nova] Creating event network-vif-deleted:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:30:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-874d9349-da0b-4a15-99ff-fc7e51e70f6b req-0d4e1b7f-e567-4a9e-b2d2-ac24b3c528c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 Apr 12 09:30:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 275/819] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a52d45c-9ce4-4e4f-973a-fffce9f85bef", "name": "network-vif-plugged", "status": "completed", "tag": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Creating event network-vif-plugged:2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef on user Apr 12 09:30:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053215 Apr 12 09:30:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 271/820] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:28 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:28 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7", "name": "network-vif-plugged", "status": "completed", "tag": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Creating event network-vif-plugged:ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 on user Apr 12 09:30:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039406 Apr 12 09:30:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 275/821] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7", "name": "network-vif-plugged", "status": "completed", "tag": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Creating event network-vif-plugged:ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 on user Apr 12 09:30:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035753 Apr 12 09:30:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 276/822] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-8b7b8182-791a-4316-aee8-aa15ec556565 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046393 Apr 12 09:30:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 272/823] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:30:35 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:30:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:30:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223" status: 204 len: 0 microversion: 2.1 time: 0.115127 Apr 12 09:30:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 276/824] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:30:35 2023] DELETE /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c" status: 204 len: 0 microversion: 2.1 time: 0.163098 Apr 12 09:30:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 277/825] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:30:35 2023] DELETE /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:36 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-73d23e9e-d09e-4525-b63b-252b204d59fe tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223" status: 200 len: 1668 microversion: 2.1 time: 0.270936 Apr 12 09:30:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 273/826] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:30:35 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:30:36 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-59c0ea91-58e0-44b6-99c4-7adda1cfdd52 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c" status: 200 len: 1501 microversion: 2.1 time: 0.297618 Apr 12 09:30:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 277/827] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:30:36 2023] GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:30:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Creating event network-vif-unplugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:30:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108463 Apr 12 09:30:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 278/828] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fc5db7-8577-4a55-a511-d9f25db0a43c", "name": "network-vif-unplugged", "status": "completed", "tag": "10aaf934-db80-40bb-9b6c-464151693b9c"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:36 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Creating event network-vif-unplugged:10aaf934-db80-40bb-9b6c-464151693b9c for instance 57fc5db7-8577-4a55-a511-d9f25db0a43c on user Apr 12 09:30:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038438 Apr 12 09:30:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 274/829] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f10eafc8-8341-4cbc-805e-d88fbadbe2f2 req-cc97bcb2-77ad-46fe-ade0-5f316f2afa15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fc5db7-8577-4a55-a511-d9f25db0a43c", "name": "network-vif-deleted", "tag": "10aaf934-db80-40bb-9b6c-464151693b9c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f10eafc8-8341-4cbc-805e-d88fbadbe2f2 req-cc97bcb2-77ad-46fe-ade0-5f316f2afa15 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f10eafc8-8341-4cbc-805e-d88fbadbe2f2 req-cc97bcb2-77ad-46fe-ade0-5f316f2afa15 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f10eafc8-8341-4cbc-805e-d88fbadbe2f2 req-cc97bcb2-77ad-46fe-ade0-5f316f2afa15 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f10eafc8-8341-4cbc-805e-d88fbadbe2f2 req-cc97bcb2-77ad-46fe-ade0-5f316f2afa15 service nova] Creating event network-vif-deleted:10aaf934-db80-40bb-9b6c-464151693b9c for instance 57fc5db7-8577-4a55-a511-d9f25db0a43c on user Apr 12 09:30:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f10eafc8-8341-4cbc-805e-d88fbadbe2f2 req-cc97bcb2-77ad-46fe-ade0-5f316f2afa15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036103 Apr 12 09:30:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 278/830] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-plugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}, {"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-plugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}, {"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-plugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}, {"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}, {"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-plugged", "status": "completed", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Creating event network-vif-plugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:30:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Creating event network-vif-plugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:30:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Creating event network-vif-plugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:30:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Creating event network-vif-unplugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:30:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Creating event network-vif-plugged:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:30:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032257 Apr 12 09:30:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 279/831] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:38 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:38 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fc5db7-8577-4a55-a511-d9f25db0a43c", "name": "network-vif-plugged", "status": "completed", "tag": "10aaf934-db80-40bb-9b6c-464151693b9c"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Creating event network-vif-plugged:10aaf934-db80-40bb-9b6c-464151693b9c for instance 57fc5db7-8577-4a55-a511-d9f25db0a43c on user Apr 12 09:30:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Apr 12 09:30:38 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 275/832] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f89aecce-4b18-44f6-8f38-b22013205ae2 req-c048cfc1-c1d2-4e9c-968a-62d524bd8f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a87d28-e580-44f4-b257-ba4b4d7fa223", "name": "network-vif-deleted", "tag": "f3d58c2b-2ae0-4211-8ab8-034c875fd516"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f89aecce-4b18-44f6-8f38-b22013205ae2 req-c048cfc1-c1d2-4e9c-968a-62d524bd8f6f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f89aecce-4b18-44f6-8f38-b22013205ae2 req-c048cfc1-c1d2-4e9c-968a-62d524bd8f6f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f89aecce-4b18-44f6-8f38-b22013205ae2 req-c048cfc1-c1d2-4e9c-968a-62d524bd8f6f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f89aecce-4b18-44f6-8f38-b22013205ae2 req-c048cfc1-c1d2-4e9c-968a-62d524bd8f6f service nova] Creating event network-vif-deleted:f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 on user Apr 12 09:30:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f89aecce-4b18-44f6-8f38-b22013205ae2 req-c048cfc1-c1d2-4e9c-968a-62d524bd8f6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029079 Apr 12 09:30:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 279/833] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:30:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:42 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7919f53d-2769-4511-9be6-026d46ffa1d5 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1545 microversion: 2.1 time: 0.337285 Apr 12 09:30:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 280/834] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:30:42 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1545 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/action" status: 200 len: 28493 microversion: 2.1 time: 0.379118 Apr 12 09:30:43 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 276/835] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:30:42 2023] POST /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/action => generated 28493 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:30:43 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:30:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3449c4db-b7bd-4216-8bfb-d13066ad1183 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42" status: 200 len: 1538 microversion: 2.1 time: 0.162214 Apr 12 09:30:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 280/836] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:30:43 2023] GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42 => generated 1538 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:31:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f2212973-9ab0-43a5-a5e6-86ba491ac77b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 200 len: 1379 microversion: 2.1 time: 0.167234 Apr 12 09:31:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 281/837] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:03 2023] GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 1379 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=20 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] HTTP exception thrown: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Request method failure captured: Apr 12 09:31:12 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef HTTP/1.1 Apr 12 09:31:12 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:31:12 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:31:12 user devstack@n-api.service[61855]: Connection: close Apr 12 09:31:12 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:31:12 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:31:12 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:31:12 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:31:12 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnciUq20yHAuU8QtTsFZHu6R5hueRwO5GQrU4eTcOqxZ2CF8DwSbbdgvAwj5kjpN3WvGFkIphABB5p0jl66SkiR3sv6Ot4ai2htJRDqajE1gOWOw1eUikks7ZFsAB6iR4XdekDWeb95wNFS_EfmwYSpx5MuNXVW9KCYpoZhzmpztg6E Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Project-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}] Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Tenant-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:12 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:12 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:12 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:31:12 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:31:12 user devstack@n-api.service[61855]: X-User-Id: d76daece06a943668e6c1c3c2c57ebaa Apr 12 09:31:12 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:12 user devstack@n-api.service[61855]: method: > Apr 12 09:31:12 user devstack@n-api.service[61855]: exception: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:12 user devstack@n-api.service[61855]: action_args: {'id': '8a52d45c-9ce4-4e4f-973a-fffce9f85bef'} Apr 12 09:31:12 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:12 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:12 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Returning 404 to user: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-57b00d72-8708-4865-be82-2b1939ce1396 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 404 len: 111 microversion: 2.20 time: 0.036824 Apr 12 09:31:12 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 277/838] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:31:12 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:31:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-af10482f-7102-41f9-9d85-f7c8391f3d7d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '.version_select at 0x7fbd5b757d90>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-af10482f-7102-41f9-9d85-f7c8391f3d7d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202654117" status: 204 len: 0 microversion: 2.20 time: 0.025385 Apr 12 09:31:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 281/839] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 09:31:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202654117 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] HTTP exception thrown: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Request method failure captured: Apr 12 09:31:15 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef HTTP/1.1 Apr 12 09:31:15 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:31:15 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:31:15 user devstack@n-api.service[61854]: Connection: close Apr 12 09:31:15 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:31:15 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:31:15 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:31:15 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:31:15 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnciUq20yHAuU8QtTsFZHu6R5hueRwO5GQrU4eTcOqxZ2CF8DwSbbdgvAwj5kjpN3WvGFkIphABB5p0jl66SkiR3sv6Ot4ai2htJRDqajE1gOWOw1eUikks7ZFsAB6iR4XdekDWeb95wNFS_EfmwYSpx5MuNXVW9KCYpoZhzmpztg6E Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Project-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}] Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Tenant-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:15 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:15 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:15 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:31:15 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:31:15 user devstack@n-api.service[61854]: X-User-Id: d76daece06a943668e6c1c3c2c57ebaa Apr 12 09:31:15 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:15 user devstack@n-api.service[61854]: method: > Apr 12 09:31:15 user devstack@n-api.service[61854]: exception: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61854]: action_args: {'id': '8a52d45c-9ce4-4e4f-973a-fffce9f85bef'} Apr 12 09:31:15 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Returning 404 to user: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6b6f1fa0-48bc-41c8-9c37-b30e9fa031aa tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 404 len: 111 microversion: 2.20 time: 0.029872 Apr 12 09:31:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 282/840] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:31:15 2023] DELETE /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] HTTP exception thrown: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Request method failure captured: Apr 12 09:31:15 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef HTTP/1.1 Apr 12 09:31:15 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:31:15 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:31:15 user devstack@n-api.service[61855]: Connection: close Apr 12 09:31:15 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:31:15 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:31:15 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:31:15 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:31:15 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnciUq20yHAuU8QtTsFZHu6R5hueRwO5GQrU4eTcOqxZ2CF8DwSbbdgvAwj5kjpN3WvGFkIphABB5p0jl66SkiR3sv6Ot4ai2htJRDqajE1gOWOw1eUikks7ZFsAB6iR4XdekDWeb95wNFS_EfmwYSpx5MuNXVW9KCYpoZhzmpztg6E Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Project-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}] Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Tenant-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:15 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:15 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:15 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:31:15 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:31:15 user devstack@n-api.service[61855]: X-User-Id: d76daece06a943668e6c1c3c2c57ebaa Apr 12 09:31:15 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:15 user devstack@n-api.service[61855]: method: > Apr 12 09:31:15 user devstack@n-api.service[61855]: exception: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61855]: action_args: {'id': '8a52d45c-9ce4-4e4f-973a-fffce9f85bef'} Apr 12 09:31:15 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. Apr 12 09:31:15 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Returning 404 to user: Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4b8e6273-eb2d-42d2-8e66-5196738b4a5a tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef" status: 404 len: 111 microversion: 2.20 time: 0.026792 Apr 12 09:31:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 278/841] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:31:15 2023] GET /compute/v2.1/servers/8a52d45c-9ce4-4e4f-973a-fffce9f85bef => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] HTTP exception thrown: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Request method failure captured: Apr 12 09:31:17 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d HTTP/1.1 Apr 12 09:31:17 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:31:17 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:31:17 user devstack@n-api.service[61853]: Connection: close Apr 12 09:31:17 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:31:17 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:31:17 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:31:17 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:31:17 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnciUq20yHAuU8QtTsFZHu6R5hueRwO5GQrU4eTcOqxZ2CF8DwSbbdgvAwj5kjpN3WvGFkIphABB5p0jl66SkiR3sv6Ot4ai2htJRDqajE1gOWOw1eUikks7ZFsAB6iR4XdekDWeb95wNFS_EfmwYSpx5MuNXVW9KCYpoZhzmpztg6E Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Project-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}] Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Tenant-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:17 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:17 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:17 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:31:17 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:31:17 user devstack@n-api.service[61853]: X-User-Id: d76daece06a943668e6c1c3c2c57ebaa Apr 12 09:31:17 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:17 user devstack@n-api.service[61853]: method: > Apr 12 09:31:17 user devstack@n-api.service[61853]: exception: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:17 user devstack@n-api.service[61853]: action_args: {'id': '25232386-f51a-434b-9280-c4dd30b55f3d'} Apr 12 09:31:17 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Returning 404 to user: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5a8b4c87-a97c-4443-8754-8b13a6050160 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 404 len: 111 microversion: 2.20 time: 0.036693 Apr 12 09:31:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 282/842] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 09:31:17 2023] DELETE /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] HTTP exception thrown: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Request method failure captured: Apr 12 09:31:18 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d HTTP/1.1 Apr 12 09:31:18 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:31:18 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:31:18 user devstack@n-api.service[61854]: Connection: close Apr 12 09:31:18 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:31:18 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:31:18 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:31:18 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:31:18 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnciUq20yHAuU8QtTsFZHu6R5hueRwO5GQrU4eTcOqxZ2CF8DwSbbdgvAwj5kjpN3WvGFkIphABB5p0jl66SkiR3sv6Ot4ai2htJRDqajE1gOWOw1eUikks7ZFsAB6iR4XdekDWeb95wNFS_EfmwYSpx5MuNXVW9KCYpoZhzmpztg6E Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Project-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ebfa64bb5194b859821a77de6805d2d"}]}] Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Tenant-Id: 6ebfa64bb5194b859821a77de6805d2d Apr 12 09:31:18 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72439030 Apr 12 09:31:18 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:18 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:31:18 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:31:18 user devstack@n-api.service[61854]: X-User-Id: d76daece06a943668e6c1c3c2c57ebaa Apr 12 09:31:18 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72439030-project-member Apr 12 09:31:18 user devstack@n-api.service[61854]: method: > Apr 12 09:31:18 user devstack@n-api.service[61854]: exception: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:18 user devstack@n-api.service[61854]: action_args: {'id': '25232386-f51a-434b-9280-c4dd30b55f3d'} Apr 12 09:31:18 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. Apr 12 09:31:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Returning 404 to user: Instance 25232386-f51a-434b-9280-c4dd30b55f3d could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6c4ec50b-4896-4c3e-b420-af212da86b32 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d" status: 404 len: 111 microversion: 2.20 time: 0.030168 Apr 12 09:31:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 283/843] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 09:31:17 2023] GET /compute/v2.1/servers/25232386-f51a-434b-9280-c4dd30b55f3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:26 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:26 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 HTTP/1.1 Apr 12 09:31:26 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:31:26 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:31:26 user devstack@n-api.service[61855]: Connection: close Apr 12 09:31:26 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:31:26 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:31:26 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:31:26 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:31:26 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:26 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:26 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:26 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:31:26 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:31:26 user devstack@n-api.service[61855]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:26 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:26 user devstack@n-api.service[61855]: method: > Apr 12 09:31:26 user devstack@n-api.service[61855]: exception: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:26 user devstack@n-api.service[61855]: action_args: {'id': 'a8a87d28-e580-44f4-b257-ba4b4d7fa223'} Apr 12 09:31:26 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:26 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:26 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-3dc3f296-9ff3-4cd3-b929-e6ad287b2837 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223" status: 404 len: 111 microversion: 2.1 time: 0.038984 Apr 12 09:31:26 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 279/844] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:26 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6ab6c995-0f1f-45a1-8eee-d5fa4fecd184 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '.version_select at 0x7fbd5b754670>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6ab6c995-0f1f-45a1-8eee-d5fa4fecd184 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362915146" status: 202 len: 0 microversion: 2.1 time: 0.030716 Apr 12 09:31:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 283/845] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 09:31:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362915146 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] HTTP exception thrown: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Request method failure captured: Apr 12 09:31:26 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c HTTP/1.1 Apr 12 09:31:26 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:31:26 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:31:26 user devstack@n-api.service[61854]: Connection: close Apr 12 09:31:26 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:31:26 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:31:26 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:31:26 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:31:26 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnldkX6cuIUfGfQjkwyt3iiOpls52K7N63eFyEWt1EPPbwOjFrPuBFzO-TkKLFl2ZzR3s51zbOBa7nwRGsbXeY-MSr5LDo2HpRTaKEsjPZHrzHsKktLTAAp35e3aht3rniU-T01ZSZKOxpId-GPRFYSn3wOjhQfAfBLSXxm1aTnfo58 Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Project-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}] Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Tenant: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Tenant-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:31:26 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:31:26 user devstack@n-api.service[61854]: X-User: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:31:26 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:31:26 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:31:26 user devstack@n-api.service[61854]: X-User-Id: 741e227a2cc7425d8b171c2a04989191 Apr 12 09:31:26 user devstack@n-api.service[61854]: X-User-Name: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:31:26 user devstack@n-api.service[61854]: method: > Apr 12 09:31:26 user devstack@n-api.service[61854]: exception: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:31:26 user devstack@n-api.service[61854]: action_args: {'id': '57fc5db7-8577-4a55-a511-d9f25db0a43c'} Apr 12 09:31:26 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:31:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Returning 404 to user: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-36ccf736-45d0-4a57-b663-0162e1e3750e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c" status: 404 len: 111 microversion: 2.1 time: 0.032351 Apr 12 09:31:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 284/846] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:26 2023] GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:26 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:31:26 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-3ceab09e-1b44-4f97-a424-3a0bf254da72 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 200 len: 1494 microversion: 2.1 time: 0.182556 Apr 12 09:31:26 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 280/847] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:26 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 1494 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:29 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 HTTP/1.1 Apr 12 09:31:29 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:31:29 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:31:29 user devstack@n-api.service[61853]: Connection: close Apr 12 09:31:29 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:31:29 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:31:29 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:31:29 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:31:29 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:29 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:29 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:29 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:31:29 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:31:29 user devstack@n-api.service[61853]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:29 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:29 user devstack@n-api.service[61853]: method: > Apr 12 09:31:29 user devstack@n-api.service[61853]: exception: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61853]: action_args: {'id': 'a8a87d28-e580-44f4-b257-ba4b4d7fa223'} Apr 12 09:31:29 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b6b2931c-8d74-4aa8-8004-75be07a0c467 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223" status: 404 len: 111 microversion: 2.1 time: 0.035252 Apr 12 09:31:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 284/848] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:31:29 2023] DELETE /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:29 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 HTTP/1.1 Apr 12 09:31:29 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:31:29 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:31:29 user devstack@n-api.service[61854]: Connection: close Apr 12 09:31:29 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:31:29 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:31:29 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:31:29 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:31:29 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:29 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:29 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:29 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:31:29 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:31:29 user devstack@n-api.service[61854]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:29 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:29 user devstack@n-api.service[61854]: method: > Apr 12 09:31:29 user devstack@n-api.service[61854]: exception: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61854]: action_args: {'id': 'a8a87d28-e580-44f4-b257-ba4b4d7fa223'} Apr 12 09:31:29 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. Apr 12 09:31:29 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bed78ce6-a5cf-4dc3-8dda-3f47e595e178 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223" status: 404 len: 111 microversion: 2.1 time: 0.030026 Apr 12 09:31:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 285/849] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:29 2023] GET /compute/v2.1/servers/a8a87d28-e580-44f4-b257-ba4b4d7fa223 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:31 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 HTTP/1.1 Apr 12 09:31:31 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:31:31 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:31:31 user devstack@n-api.service[61855]: Connection: close Apr 12 09:31:31 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:31:31 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:31:31 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:31:31 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:31:31 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61855]: method: > Apr 12 09:31:31 user devstack@n-api.service[61855]: exception: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: action_args: {'id': 'd64edc05-fbf3-4f89-908f-ca221919c596'} Apr 12 09:31:31 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-37683e6d-2414-488e-ac9e-af77a15243d1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596" status: 404 len: 111 microversion: 2.1 time: 0.035444 Apr 12 09:31:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 281/850] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:31:31 2023] DELETE /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:31 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 HTTP/1.1 Apr 12 09:31:31 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:31:31 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:31:31 user devstack@n-api.service[61853]: Connection: close Apr 12 09:31:31 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:31:31 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:31:31 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:31:31 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:31:31 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61853]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:31 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61853]: method: > Apr 12 09:31:31 user devstack@n-api.service[61853]: exception: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61853]: action_args: {'id': 'd64edc05-fbf3-4f89-908f-ca221919c596'} Apr 12 09:31:31 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-cac82e96-008f-453c-a2cc-e7a4d48af21e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596" status: 404 len: 111 microversion: 2.1 time: 0.034318 Apr 12 09:31:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 285/851] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:31 2023] GET /compute/v2.1/servers/d64edc05-fbf3-4f89-908f-ca221919c596 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:31 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 HTTP/1.1 Apr 12 09:31:31 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:31:31 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:31:31 user devstack@n-api.service[61854]: Connection: close Apr 12 09:31:31 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:31:31 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:31:31 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:31:31 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:31:31 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61854]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:31 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61854]: method: > Apr 12 09:31:31 user devstack@n-api.service[61854]: exception: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61854]: action_args: {'id': 'dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6'} Apr 12 09:31:31 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d94a290e-4745-4fa4-9b47-7587662c9098 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" status: 404 len: 111 microversion: 2.1 time: 0.027046 Apr 12 09:31:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 286/852] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:31:31 2023] DELETE /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:31 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 HTTP/1.1 Apr 12 09:31:31 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:31:31 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:31:31 user devstack@n-api.service[61855]: Connection: close Apr 12 09:31:31 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:31:31 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:31:31 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:31:31 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:31:31 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:31 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:31 user devstack@n-api.service[61855]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:31 user devstack@n-api.service[61855]: method: > Apr 12 09:31:31 user devstack@n-api.service[61855]: exception: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: action_args: {'id': 'dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6'} Apr 12 09:31:31 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. Apr 12 09:31:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:31:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-6f80a64b-2768-41f0-819a-6d5ee3d27396 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" status: 404 len: 111 microversion: 2.1 time: 0.026978 Apr 12 09:31:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 282/853] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:31 2023] GET /compute/v2.1/servers/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:33 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d HTTP/1.1 Apr 12 09:31:33 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:31:33 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:31:33 user devstack@n-api.service[61853]: Connection: close Apr 12 09:31:33 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:31:33 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:31:33 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:31:33 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:31:33 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:33 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:33 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:33 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:31:33 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:31:33 user devstack@n-api.service[61853]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:33 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:33 user devstack@n-api.service[61853]: method: > Apr 12 09:31:33 user devstack@n-api.service[61853]: exception: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61853]: action_args: {'id': '9691009c-8aca-4347-8e46-c5bdda13aa3d'} Apr 12 09:31:33 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5b5205b0-fd7a-4840-95c9-28a4302c5998 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d" status: 404 len: 111 microversion: 2.1 time: 0.031495 Apr 12 09:31:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 286/854] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:31:33 2023] DELETE /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HTTP exception thrown: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Request method failure captured: Apr 12 09:31:33 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d HTTP/1.1 Apr 12 09:31:33 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:31:33 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:31:33 user devstack@n-api.service[61854]: Connection: close Apr 12 09:31:33 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:31:33 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:31:33 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:31:33 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:31:33 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNncl-hVHUIWD6YkJCiIZ17kL21lyS82ZEtAllmv9MWtfy6dkNyXm1QpFKoaRPeQv6BLnw9d4hF-ewqXGQlGDVprpQuL0G8ZbNuEHeCzmiM2abexXAOjfBWkI1lzDKR9BmaFQae7MOlrOhzJDe6QvLSl5FQcXLR7tw1b9Zykx903FLik Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Project-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b4beaf457f4120bcbcd2b033d5c3db"}]}] Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Tenant-Id: 37b4beaf457f4120bcbcd2b033d5c3db Apr 12 09:31:33 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-395431601 Apr 12 09:31:33 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:33 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:31:33 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:31:33 user devstack@n-api.service[61854]: X-User-Id: 5f91fed06f9547d29125f38fe2d47221 Apr 12 09:31:33 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeNegativeTest-395431601-project-member Apr 12 09:31:33 user devstack@n-api.service[61854]: method: > Apr 12 09:31:33 user devstack@n-api.service[61854]: exception: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61854]: action_args: {'id': '9691009c-8aca-4347-8e46-c5bdda13aa3d'} Apr 12 09:31:33 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. Apr 12 09:31:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:31:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Returning 404 to user: Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:31:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6546aa7e-a5b6-4acf-ad0b-11bb9c5c0d6c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d" status: 404 len: 111 microversion: 2.1 time: 0.036356 Apr 12 09:31:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 287/855] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:33 2023] GET /compute/v2.1/servers/9691009c-8aca-4347-8e46-c5bdda13aa3d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=8 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=12 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:43 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:31:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 204 len: 0 microversion: 2.1 time: 0.131302 Apr 12 09:31:43 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 283/856] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:31:43 2023] DELETE /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:43 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:31:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-87a074a2-851a-4a7e-aa06-d87c84e458d8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 200 len: 1551 microversion: 2.1 time: 0.166553 Apr 12 09:31:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 287/857] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:31:43 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:31:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-unplugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:31:44 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:44 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:31:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Creating event network-vif-unplugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:31:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032732 Apr 12 09:31:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 288/858] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:31:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:31:46 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-plugged", "status": "completed", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}, {"server_uuid": "6720b589-6dc8-460a-bdc2-52b9b1cd77fb", "name": "network-vif-deleted", "tag": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:31:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:31:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:31:46 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:31:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Creating event network-vif-plugged:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:31:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Creating event network-vif-deleted:d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb on user Apr 12 09:31:46 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031037 Apr 12 09:31:46 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 284/859] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:03 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:32:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c52789c8-3208-4c44-a2d5-78c6bafd386e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 200 len: 1379 microversion: 2.1 time: 0.159302 Apr 12 09:32:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 288/860] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:03 2023] GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 1379 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:04 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:32:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6d7fc007-6feb-48b4-b492-a750a06f5bea tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 200 len: 1379 microversion: 2.1 time: 0.181381 Apr 12 09:32:04 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 289/861] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:03 2023] GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 1379 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:04 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:32:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 204 len: 0 microversion: 2.1 time: 0.169652 Apr 12 09:32:04 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 285/862] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:32:04 2023] DELETE /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:05 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:32:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-11bc3c14-417f-4dae-8fa0-6d36eb2e5136 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 200 len: 1385 microversion: 2.1 time: 0.656788 Apr 12 09:32:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 289/863] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:04 2023] GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 1385 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:32:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7", "name": "network-vif-unplugged", "status": "completed", "tag": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:32:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Creating event network-vif-unplugged:ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 on user Apr 12 09:32:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046160 Apr 12 09:32:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 290/864] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:32:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:32:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-516868ac-c7b6-4cc9-8208-ef75bec9afe7 req-62f3a1df-ed09-4488-bedb-a7873aa22c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7", "name": "network-vif-deleted", "tag": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:32:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-516868ac-c7b6-4cc9-8208-ef75bec9afe7 req-62f3a1df-ed09-4488-bedb-a7873aa22c03 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-516868ac-c7b6-4cc9-8208-ef75bec9afe7 req-62f3a1df-ed09-4488-bedb-a7873aa22c03 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-516868ac-c7b6-4cc9-8208-ef75bec9afe7 req-62f3a1df-ed09-4488-bedb-a7873aa22c03 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-516868ac-c7b6-4cc9-8208-ef75bec9afe7 req-62f3a1df-ed09-4488-bedb-a7873aa22c03 service nova] Creating event network-vif-deleted:ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 on user Apr 12 09:32:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-516868ac-c7b6-4cc9-8208-ef75bec9afe7 req-62f3a1df-ed09-4488-bedb-a7873aa22c03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074624 Apr 12 09:32:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 286/865] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:32:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7", "name": "network-vif-plugged", "status": "completed", "tag": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:32:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Creating event network-vif-plugged:ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 on user Apr 12 09:32:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041487 Apr 12 09:32:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 290/866] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:32:28 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:28 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-451e7d12-df26-4efd-ab8a-7fe007bfa4c6 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1153676668", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a4be89d8-81d3-447b-8b6f-27c2ec7efa95", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bbc0bb34-7666-4c19-b2a4-d272ba7af767"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:32:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-451e7d12-df26-4efd-ab8a-7fe007bfa4c6 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] HTTP exception thrown: Block Device a4be89d8-81d3-447b-8b6f-27c2ec7efa95 is not bootable. Apr 12 09:32:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-451e7d12-df26-4efd-ab8a-7fe007bfa4c6 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Request method failure captured: Apr 12 09:32:28 user devstack@n-api.service[61854]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 09:32:28 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:32:28 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:32:28 user devstack@n-api.service[61854]: Connection: close Apr 12 09:32:28 user devstack@n-api.service[61854]: Content-Length: 357 Apr 12 09:32:28 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:32:28 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:32:28 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:32:28 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnldkX6cuIUfGfQjkwyt3iiOpls52K7N63eFyEWt1EPPbwOjFrPuBFzO-TkKLFl2ZzR3s51zbOBa7nwRGsbXeY-MSr5LDo2HpRTaKEsjPZHrzHsKktLTAAp35e3aht3rniU-T01ZSZKOxpId-GPRFYSn3wOjhQfAfBLSXxm1aTnfo58 Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Project-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}] Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Tenant: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Tenant-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:32:28 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:32:28 user devstack@n-api.service[61854]: X-User: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:32:28 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:32:28 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:32:28 user devstack@n-api.service[61854]: X-User-Id: 741e227a2cc7425d8b171c2a04989191 Apr 12 09:32:28 user devstack@n-api.service[61854]: X-User-Name: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:32:28 user devstack@n-api.service[61854]: Apr 12 09:32:28 user devstack@n-api.service[61854]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1153676668", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a4be89d8-81d3-447b-8b6f-27c2ec7efa95", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bbc0bb34-7666-4c19-b2a4-d272ba7af767"}]}} Apr 12 09:32:28 user devstack@n-api.service[61854]: method: > Apr 12 09:32:28 user devstack@n-api.service[61854]: exception: Block Device a4be89d8-81d3-447b-8b6f-27c2ec7efa95 is not bootable. Apr 12 09:32:28 user devstack@n-api.service[61854]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1153676668', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a4be89d8-81d3-447b-8b6f-27c2ec7efa95'}], 'networks': [{'uuid': 'bbc0bb34-7666-4c19-b2a4-d272ba7af767'}]}}} Apr 12 09:32:28 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a4be89d8-81d3-447b-8b6f-27c2ec7efa95 is not bootable. Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a4be89d8-81d3-447b-8b6f-27c2ec7efa95 is not bootable. Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a4be89d8-81d3-447b-8b6f-27c2ec7efa95 is not bootable. Apr 12 09:32:28 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-451e7d12-df26-4efd-ab8a-7fe007bfa4c6 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Returning 400 to user: Block Device a4be89d8-81d3-447b-8b6f-27c2ec7efa95 is not bootable. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:32:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-451e7d12-df26-4efd-ab8a-7fe007bfa4c6 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.081544 Apr 12 09:32:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 291/867] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:32:28 2023] POST /compute/v2.1/servers => generated 110 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:28 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:32:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a7885fcf-2a6c-4771-9a35-fe58fbf3d126 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 200 len: 1494 microversion: 2.1 time: 0.178398 Apr 12 09:32:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 287/868] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:28 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 1494 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=14 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:32:34 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb HTTP/1.1 Apr 12 09:32:34 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:32:34 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:32:34 user devstack@n-api.service[61853]: Connection: close Apr 12 09:32:34 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:32:34 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:32:34 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:32:34 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:32:34 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:32:34 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61853]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:32:34 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:32:34 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:32:34 user devstack@n-api.service[61853]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:32:34 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:32:34 user devstack@n-api.service[61853]: method: > Apr 12 09:32:34 user devstack@n-api.service[61853]: exception: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61853]: action_args: {'id': '6720b589-6dc8-460a-bdc2-52b9b1cd77fb'} Apr 12 09:32:34 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:32:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e4705a92-4f22-4dc4-8a21-7f8a227bb2a0 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 404 len: 111 microversion: 2.1 time: 0.034647 Apr 12 09:32:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 291/869] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:34 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:32:34 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb HTTP/1.1 Apr 12 09:32:34 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:32:34 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:32:34 user devstack@n-api.service[61854]: Connection: close Apr 12 09:32:34 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:32:34 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:32:34 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:32:34 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:32:34 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:32:34 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61854]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:32:34 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:32:34 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:32:34 user devstack@n-api.service[61854]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:32:34 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:32:34 user devstack@n-api.service[61854]: method: > Apr 12 09:32:34 user devstack@n-api.service[61854]: exception: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61854]: action_args: {'id': '6720b589-6dc8-460a-bdc2-52b9b1cd77fb'} Apr 12 09:32:34 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:32:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7e6a4c11-6464-4a0a-a357-a9080c68fd41 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 404 len: 111 microversion: 2.1 time: 0.028524 Apr 12 09:32:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 292/870] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:32:34 2023] DELETE /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:32:34 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb HTTP/1.1 Apr 12 09:32:34 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:32:34 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:32:34 user devstack@n-api.service[61855]: Connection: close Apr 12 09:32:34 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:32:34 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:32:34 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:32:34 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:32:34 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:32:34 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:32:34 user devstack@n-api.service[61855]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:32:34 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:32:34 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:32:34 user devstack@n-api.service[61855]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:32:34 user devstack@n-api.service[61855]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:32:34 user devstack@n-api.service[61855]: method: > Apr 12 09:32:34 user devstack@n-api.service[61855]: exception: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61855]: action_args: {'id': '6720b589-6dc8-460a-bdc2-52b9b1cd77fb'} Apr 12 09:32:34 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. Apr 12 09:32:34 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:32:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-33e630d2-aa6f-4e85-9e96-0db6bd981cb8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb" status: 404 len: 111 microversion: 2.1 time: 0.029415 Apr 12 09:32:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 288/871] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:34 2023] GET /compute/v2.1/servers/6720b589-6dc8-460a-bdc2-52b9b1cd77fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:32:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42" status: 204 len: 0 microversion: 2.1 time: 0.115243 Apr 12 09:32:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 292/872] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:32:34 2023] DELETE /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:32:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-10b926dc-7e77-4970-b05b-ec6cfb7c19c4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42" status: 200 len: 1544 microversion: 2.1 time: 0.212140 Apr 12 09:32:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 293/873] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:34 2023] GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42 => generated 1544 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "name": "network-vif-unplugged", "status": "completed", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Creating event network-vif-unplugged:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:32:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035566 Apr 12 09:32:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 289/874] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:32:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:32:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "name": "network-vif-deleted", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:32:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] Creating event network-vif-deleted:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:32:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032101 Apr 12 09:32:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 293/875] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:32:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:32:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2be3178-85b4-4012-a7d0-2d8543a65a42", "name": "network-vif-plugged", "status": "completed", "tag": "0ea8781f-860c-4135-8264-ad52a792fa55"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:32:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Creating event network-vif-plugged:0ea8781f-860c-4135-8264-ad52a792fa55 for instance d2be3178-85b4-4012-a7d0-2d8543a65a42 on user Apr 12 09:32:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 Apr 12 09:32:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 294/876] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:32:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:55 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:32:55 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 HTTP/1.1 Apr 12 09:32:55 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:32:55 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:32:55 user devstack@n-api.service[61855]: Connection: close Apr 12 09:32:55 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:32:55 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:32:55 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:32:55 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:32:55 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:32:55 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61855]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:32:55 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:32:55 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:32:55 user devstack@n-api.service[61855]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:32:55 user devstack@n-api.service[61855]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:32:55 user devstack@n-api.service[61855]: method: > Apr 12 09:32:55 user devstack@n-api.service[61855]: exception: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61855]: action_args: {'id': 'a1d6aa01-e33d-4081-8c83-fb074b9dfaa7'} Apr 12 09:32:55 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:32:55 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-07f48242-ab22-441a-8f1e-90fffdb27493 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 404 len: 111 microversion: 2.1 time: 0.038733 Apr 12 09:32:55 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 290/877] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:55 2023] GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:32:55 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 HTTP/1.1 Apr 12 09:32:55 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:32:55 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:32:55 user devstack@n-api.service[61853]: Connection: close Apr 12 09:32:55 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:32:55 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:32:55 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:32:55 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:32:55 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:32:55 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61853]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:32:55 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:32:55 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:32:55 user devstack@n-api.service[61853]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:32:55 user devstack@n-api.service[61853]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:32:55 user devstack@n-api.service[61853]: method: > Apr 12 09:32:55 user devstack@n-api.service[61853]: exception: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61853]: action_args: {'id': 'a1d6aa01-e33d-4081-8c83-fb074b9dfaa7'} Apr 12 09:32:55 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:32:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e8d48052-4a1b-4f52-aaab-f65d8ec5a68b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 404 len: 111 microversion: 2.1 time: 0.035705 Apr 12 09:32:55 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 294/878] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:32:55 2023] DELETE /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:32:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:32:55 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 HTTP/1.1 Apr 12 09:32:55 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:32:55 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:32:55 user devstack@n-api.service[61854]: Connection: close Apr 12 09:32:55 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:32:55 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:32:55 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:32:55 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:32:55 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:32:55 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:32:55 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:32:55 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:32:55 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:32:55 user devstack@n-api.service[61854]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:32:55 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:32:55 user devstack@n-api.service[61854]: method: > Apr 12 09:32:55 user devstack@n-api.service[61854]: exception: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61854]: action_args: {'id': 'a1d6aa01-e33d-4081-8c83-fb074b9dfaa7'} Apr 12 09:32:55 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. Apr 12 09:32:55 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:32:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:32:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3fe75ebe-e033-4474-9330-2bd018c39de4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" status: 404 len: 111 microversion: 2.1 time: 0.034731 Apr 12 09:32:55 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 295/879] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:32:55 2023] GET /compute/v2.1/servers/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-241380053", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "8004e131-a0ca-4d62-9c3b-2d379228886e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "04d87eab-eb0c-4ca0-b654-941b5fb8be90"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] validate_networks() for [('04d87eab-eb0c-4ca0-b654-941b5fb8be90', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:03 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:33:03 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for user 4d3fba65a6ff4e73addd3ec6cdbb08cf and project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:33:03 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:33:03 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8004e131-a0ca-4d62-9c3b-2d379228886e',volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:33:03 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.840439 Apr 12 09:33:03 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 291/880] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:33:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:33:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-073bf79b-0285-455a-9a1c-55c970d1c74e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-073bf79b-0285-455a-9a1c-55c970d1c74e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:33:03 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-073bf79b-0285-455a-9a1c-55c970d1c74e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:33:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-073bf79b-0285-455a-9a1c-55c970d1c74e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 200 len: 1065 microversion: 2.1 time: 0.065746 Apr 12 09:33:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 295/881] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:33:03 2023] GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 1065 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:33:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd463b2a-f10b-424a-b199-c8db4aa486bf", "tag": "ccf2d9f7-9747-4452-9248-874c2b8b23cf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:33:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Creating event network-changed:ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance cd463b2a-f10b-424a-b199-c8db4aa486bf on user Apr 12 09:33:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038558 Apr 12 09:33:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 296/882] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:33:11 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd463b2a-f10b-424a-b199-c8db4aa486bf", "name": "network-vif-plugged", "status": "completed", "tag": "ccf2d9f7-9747-4452-9248-874c2b8b23cf"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:33:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Creating event network-vif-plugged:ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance cd463b2a-f10b-424a-b199-c8db4aa486bf on user Apr 12 09:33:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040358 Apr 12 09:33:11 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 292/883] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd463b2a-f10b-424a-b199-c8db4aa486bf", "name": "network-vif-plugged", "status": "completed", "tag": "ccf2d9f7-9747-4452-9248-874c2b8b23cf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:33:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Creating event network-vif-plugged:ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance cd463b2a-f10b-424a-b199-c8db4aa486bf on user Apr 12 09:33:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034467 Apr 12 09:33:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 296/884] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 could not be found. Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:33:24 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42 HTTP/1.1 Apr 12 09:33:24 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:33:24 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:33:24 user devstack@n-api.service[61854]: Connection: close Apr 12 09:33:24 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:33:24 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:33:24 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:33:24 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:33:24 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:33:24 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:24 user devstack@n-api.service[61854]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:33:24 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:33:24 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:33:24 user devstack@n-api.service[61854]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:33:24 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:33:24 user devstack@n-api.service[61854]: method: > Apr 12 09:33:24 user devstack@n-api.service[61854]: exception: Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 could not be found. Apr 12 09:33:24 user devstack@n-api.service[61854]: action_args: {'id': 'd2be3178-85b4-4012-a7d0-2d8543a65a42'} Apr 12 09:33:24 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 could not be found. Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 could not be found. Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 could not be found. Apr 12 09:33:24 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:33:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9a17cb20-2e2a-4e2b-8b81-6b2f60a161df tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42" status: 404 len: 111 microversion: 2.1 time: 0.035398 Apr 12 09:33:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 297/885] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:33:24 2023] GET /compute/v2.1/servers/d2be3178-85b4-4012-a7d0-2d8543a65a42 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:28 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:33:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-fda30e65-6df4-4801-89de-0ddee5a2ff97 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 200 len: 1494 microversion: 2.1 time: 0.196955 Apr 12 09:33:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 293/886] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:33:28 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 1494 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:33:30 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 HTTP/1.1 Apr 12 09:33:30 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:33:30 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:33:30 user devstack@n-api.service[61853]: Connection: close Apr 12 09:33:30 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:33:30 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:33:30 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:33:30 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:33:30 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:33:30 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:30 user devstack@n-api.service[61853]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:33:30 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:33:30 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:33:30 user devstack@n-api.service[61853]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:33:30 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:33:30 user devstack@n-api.service[61853]: method: > Apr 12 09:33:30 user devstack@n-api.service[61853]: exception: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61853]: action_args: {'id': '4f211820-161b-4bef-b25d-ced137325da1'} Apr 12 09:33:30 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:33:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-44012f32-eef5-479d-87ea-09a743182dcc tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 404 len: 111 microversion: 2.1 time: 0.033094 Apr 12 09:33:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 297/887] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:33:30 2023] DELETE /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HTTP exception thrown: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Request method failure captured: Apr 12 09:33:30 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 HTTP/1.1 Apr 12 09:33:30 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:33:30 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:33:30 user devstack@n-api.service[61854]: Connection: close Apr 12 09:33:30 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:33:30 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:33:30 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:33:30 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:33:30 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnUfAv38QUQ4ZDV_6oBDkgnPlYWeRcqULWa_hKMK9Wn0RNw9Sfv0Nmbi5KGzfbrET_Lyk8FOXLsp9yzA9RBtrkf3jBF0IWjYHP6dMm9KLxBfapOqnYSleM-q-fUMCHj0H4jAA8KyChEmPxQzpGLhnG4OeekF4QVy-cTRH6dNIT008QU Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Project-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8c89c46bb460f9f94be9426a22bb8"}]}] Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Tenant-Id: 20b8c89c46bb460f9f94be9426a22bb8 Apr 12 09:33:30 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerActionsTestJSON-1142062861 Apr 12 09:33:30 user devstack@n-api.service[61854]: X-User: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:33:30 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:33:30 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:33:30 user devstack@n-api.service[61854]: X-User-Id: 375db5b9a80244d3878822049230ba47 Apr 12 09:33:30 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerActionsTestJSON-1142062861-project-member Apr 12 09:33:30 user devstack@n-api.service[61854]: method: > Apr 12 09:33:30 user devstack@n-api.service[61854]: exception: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61854]: action_args: {'id': '4f211820-161b-4bef-b25d-ced137325da1'} Apr 12 09:33:30 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. Apr 12 09:33:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Returning 404 to user: Instance 4f211820-161b-4bef-b25d-ced137325da1 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:33:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a92617e1-67c5-4615-8a7b-1ad270c60277 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1" status: 404 len: 111 microversion: 2.1 time: 0.032484 Apr 12 09:33:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 298/888] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:33:30 2023] GET /compute/v2.1/servers/4f211820-161b-4bef-b25d-ced137325da1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-ab5e0b3b-5370-4cdb-bf0b-d8c64e9e9ec7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Calling method '.version_select at 0x7fbd5b796440>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-ab5e0b3b-5370-4cdb-bf0b-d8c64e9e9ec7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-184491568" status: 202 len: 0 microversion: 2.1 time: 0.025835 Apr 12 09:33:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 294/889] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 09:33:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-184491568 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:33:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-316f3332-7b83-451f-90d5-7edef14d581b tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b8b7640>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2066360266"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:33:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-316f3332-7b83-451f-90d5-7edef14d581b tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.485745 Apr 12 09:33:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 298/890] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 09:33:35 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 487 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 09:33:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-87267c0f-6cbc-4377-b5d4-2d03d3adaf61 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b803250>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-87267c0f-6cbc-4377-b5d4-2d03d3adaf61 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 200 len: 345 microversion: 2.1 time: 0.052456 Apr 12 09:33:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 299/891] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:33:35 2023] GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:36 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6442d4ab-53fd-4560-a97e-e3e2179fba39 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b7d5a20>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:36 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-6442d4ab-53fd-4560-a97e-e3e2179fba39 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 200 len: 346 microversion: 2.1 time: 0.051107 Apr 12 09:33:36 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 295/892] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:33:36 2023] GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-289c7da3-8582-4462-a342-a5e471ce3cfb tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b7a5870>, body: {"snapshot": {"volume_id": "d796fe18-c919-4aff-a22e-eded1b66fbf2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1404216198"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:33:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-289c7da3-8582-4462-a342-a5e471ce3cfb tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.223652 Apr 12 09:33:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 299/893] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 09:33:36 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-25c7a268-d175-462d-8a37-c70539c48051 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b8ce440>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-25c7a268-d175-462d-8a37-c70539c48051 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 200 len: 287 microversion: 2.1 time: 0.034693 Apr 12 09:33:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 300/894] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 09:33:37 2023] GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:37 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a34500cf-bb0e-4fa3-aba1-5968f48706c9 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b73d900>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:37 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a34500cf-bb0e-4fa3-aba1-5968f48706c9 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039116 Apr 12 09:33:37 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 296/895] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 09:33:37 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-94eb287b-ec21-46e6-838a-645a3e2b7f9c tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b8b4040>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-94eb287b-ec21-46e6-838a-645a3e2b7f9c tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 200 len: 287 microversion: 2.1 time: 0.032286 Apr 12 09:33:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 300/896] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 09:33:37 2023] GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f9e98ed8-278f-42e4-87c4-43538c9c79cd tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b870790>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f9e98ed8-278f-42e4-87c4-43538c9c79cd tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 200 len: 287 microversion: 2.1 time: 0.040639 Apr 12 09:33:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 301/897] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 09:33:38 2023] GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:39 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-8fe89155-68fa-492d-8593-6ca1512210fd tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b7d5b40>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-8fe89155-68fa-492d-8593-6ca1512210fd tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 200 len: 288 microversion: 2.1 time: 0.035043 Apr 12 09:33:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 297/898] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 09:33:39 2023] GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a290ae04-acb7-431c-a740-9b67dd806943 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b7a5ea0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a290ae04-acb7-431c-a740-9b67dd806943 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 202 len: 0 microversion: 2.1 time: 0.066826 Apr 12 09:33:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 301/899] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 09:33:39 2023] DELETE /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:33:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ee4b7b7f-4fad-46c8-9224-160b68aacc0d tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b751900>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ee4b7b7f-4fad-46c8-9224-160b68aacc0d tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 200 len: 287 microversion: 2.1 time: 0.035523 Apr 12 09:33:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 302/900] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 09:33:39 2023] GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:40 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-dfac2d44-13f2-4892-809e-a0fb8fbaca3c tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b73da20>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:40 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-dfac2d44-13f2-4892-809e-a0fb8fbaca3c tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 200 len: 287 microversion: 2.1 time: 0.038966 Apr 12 09:33:40 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 298/901] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 09:33:40 2023] GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:41 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:41 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-66a5219a-e1f8-4a36-8aea-ca70729c6b4f tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b8b79a0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-66a5219a-e1f8-4a36-8aea-ca70729c6b4f tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] HTTP exception thrown: Snapshot c337f672-84fb-4095-82f8-cd5e29b503c0 could not be found. Apr 12 09:33:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-66a5219a-e1f8-4a36-8aea-ca70729c6b4f tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Request method failure captured: Apr 12 09:33:41 user devstack@n-api.service[61853]: request: GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 HTTP/1.1 Apr 12 09:33:41 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:33:41 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:33:41 user devstack@n-api.service[61853]: Connection: close Apr 12 09:33:41 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:33:41 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:33:41 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:33:41 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:33:41 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnrvwiIaH9vO4pZFinByImAk2olP-Ai77FTUxFFrv7OGe5-FXMm9nbSvc6TE6WuFt_p7XyM_ZIAzzqZ5pf0TNpuhSYCFnPu4fjnDmL-FFsazAYTiue7kFnLiqo3koZnJEuT_FkWtdoSDDfhl2CFh-G0aiooliRXyXGQgxwU_E6PadG4 Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Project-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}] Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Tenant-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:41 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:41 user devstack@n-api.service[61853]: X-User: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:41 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:33:41 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:33:41 user devstack@n-api.service[61853]: X-User-Id: d932e5d83a9c41ce9518925b68de294d Apr 12 09:33:41 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:41 user devstack@n-api.service[61853]: method: Apr 12 09:33:41 user devstack@n-api.service[61853]: exception: Snapshot c337f672-84fb-4095-82f8-cd5e29b503c0 could not be found. Apr 12 09:33:41 user devstack@n-api.service[61853]: action_args: {'id': 'c337f672-84fb-4095-82f8-cd5e29b503c0'} Apr 12 09:33:41 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c337f672-84fb-4095-82f8-cd5e29b503c0 could not be found. (HTTP 404) (Request-ID: req-b60f9b5d-f870-4ebe-8394-189531bdff3d) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c337f672-84fb-4095-82f8-cd5e29b503c0 could not be found. Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c337f672-84fb-4095-82f8-cd5e29b503c0 could not be found. Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c337f672-84fb-4095-82f8-cd5e29b503c0 could not be found. Apr 12 09:33:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-66a5219a-e1f8-4a36-8aea-ca70729c6b4f tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Returning 404 to user: Snapshot c337f672-84fb-4095-82f8-cd5e29b503c0 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:33:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-66a5219a-e1f8-4a36-8aea-ca70729c6b4f tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0" status: 404 len: 111 microversion: 2.1 time: 0.053770 Apr 12 09:33:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 302/902] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 09:33:41 2023] GET /compute/v2.1/os-snapshots/c337f672-84fb-4095-82f8-cd5e29b503c0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:33:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ff8e8a6b-aff0-4db4-ba1f-dc10361135c3 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5baeb1c0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ff8e8a6b-aff0-4db4-ba1f-dc10361135c3 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 202 len: 0 microversion: 2.1 time: 0.070112 Apr 12 09:33:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 303/903] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:33:41 2023] DELETE /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:33:41 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d1a7d842-403f-4284-8487-002af183bade tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b7d5ab0>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d1a7d842-403f-4284-8487-002af183bade tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 200 len: 345 microversion: 2.1 time: 0.054052 Apr 12 09:33:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 299/904] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:33:41 2023] GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:33:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5ed586a4-9b7e-49c9-83c2-6acf7e09b8de tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b7a5480>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5ed586a4-9b7e-49c9-83c2-6acf7e09b8de tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 200 len: 345 microversion: 2.1 time: 0.051331 Apr 12 09:33:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 303/905] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:33:42 2023] GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:33:43 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7be80548-1f37-454f-aa0c-d1d316196885 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b8cec20>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-7be80548-1f37-454f-aa0c-d1d316196885 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] HTTP exception thrown: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7be80548-1f37-454f-aa0c-d1d316196885 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Request method failure captured: Apr 12 09:33:43 user devstack@n-api.service[61854]: request: GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 HTTP/1.1 Apr 12 09:33:43 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:33:43 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:33:43 user devstack@n-api.service[61854]: Connection: close Apr 12 09:33:43 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:33:43 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:33:43 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:33:43 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:33:43 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnrvwiIaH9vO4pZFinByImAk2olP-Ai77FTUxFFrv7OGe5-FXMm9nbSvc6TE6WuFt_p7XyM_ZIAzzqZ5pf0TNpuhSYCFnPu4fjnDmL-FFsazAYTiue7kFnLiqo3koZnJEuT_FkWtdoSDDfhl2CFh-G0aiooliRXyXGQgxwU_E6PadG4 Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Project-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}] Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Tenant-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:43 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61854]: X-User: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:43 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:33:43 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:33:43 user devstack@n-api.service[61854]: X-User-Id: d932e5d83a9c41ce9518925b68de294d Apr 12 09:33:43 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:43 user devstack@n-api.service[61854]: method: Apr 12 09:33:43 user devstack@n-api.service[61854]: exception: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61854]: action_args: {'id': 'd796fe18-c919-4aff-a22e-eded1b66fbf2'} Apr 12 09:33:43 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. (HTTP 404) (Request-ID: req-0bd1d759-9cc6-45da-a463-7550d7f9c412) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7be80548-1f37-454f-aa0c-d1d316196885 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Returning 404 to user: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:33:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7be80548-1f37-454f-aa0c-d1d316196885 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 404 len: 109 microversion: 2.1 time: 0.035840 Apr 12 09:33:43 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 304/906] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:33:43 2023] GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-56b56caf-30e4-4c20-9d3f-dcc07a83b0fe tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b796c20>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-56b56caf-30e4-4c20-9d3f-dcc07a83b0fe tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] HTTP exception thrown: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-56b56caf-30e4-4c20-9d3f-dcc07a83b0fe tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Request method failure captured: Apr 12 09:33:43 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 HTTP/1.1 Apr 12 09:33:43 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:33:43 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:33:43 user devstack@n-api.service[61855]: Connection: close Apr 12 09:33:43 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:33:43 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:33:43 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:33:43 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:33:43 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnrvwiIaH9vO4pZFinByImAk2olP-Ai77FTUxFFrv7OGe5-FXMm9nbSvc6TE6WuFt_p7XyM_ZIAzzqZ5pf0TNpuhSYCFnPu4fjnDmL-FFsazAYTiue7kFnLiqo3koZnJEuT_FkWtdoSDDfhl2CFh-G0aiooliRXyXGQgxwU_E6PadG4 Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Project-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}] Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Tenant-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:43 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61855]: X-User: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:43 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:33:43 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:33:43 user devstack@n-api.service[61855]: X-User-Id: d932e5d83a9c41ce9518925b68de294d Apr 12 09:33:43 user devstack@n-api.service[61855]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:43 user devstack@n-api.service[61855]: method: Apr 12 09:33:43 user devstack@n-api.service[61855]: exception: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61855]: action_args: {'id': 'd796fe18-c919-4aff-a22e-eded1b66fbf2'} Apr 12 09:33:43 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. (HTTP 404) (Request-ID: req-1e4589e6-af1c-4849-8876-4178891a039c) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-56b56caf-30e4-4c20-9d3f-dcc07a83b0fe tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Returning 404 to user: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:33:43 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-56b56caf-30e4-4c20-9d3f-dcc07a83b0fe tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 404 len: 109 microversion: 2.1 time: 0.107414 Apr 12 09:33:43 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 300/907] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:33:43 2023] DELETE /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c0e0a07a-7e9d-4efc-a480-8289c059bff4 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Calling method '.version_select at 0x7fbd5b7a75b0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-c0e0a07a-7e9d-4efc-a480-8289c059bff4 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] HTTP exception thrown: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c0e0a07a-7e9d-4efc-a480-8289c059bff4 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Request method failure captured: Apr 12 09:33:43 user devstack@n-api.service[61853]: request: GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 HTTP/1.1 Apr 12 09:33:43 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:33:43 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:33:43 user devstack@n-api.service[61853]: Connection: close Apr 12 09:33:43 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:33:43 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:33:43 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:33:43 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:33:43 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnrvwiIaH9vO4pZFinByImAk2olP-Ai77FTUxFFrv7OGe5-FXMm9nbSvc6TE6WuFt_p7XyM_ZIAzzqZ5pf0TNpuhSYCFnPu4fjnDmL-FFsazAYTiue7kFnLiqo3koZnJEuT_FkWtdoSDDfhl2CFh-G0aiooliRXyXGQgxwU_E6PadG4 Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Project-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a613f3bbbd44e17b428d60ade8890c7"}]}] Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Tenant-Id: 2a613f3bbbd44e17b428d60ade8890c7 Apr 12 09:33:43 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1479647676 Apr 12 09:33:43 user devstack@n-api.service[61853]: X-User: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:43 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:33:43 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:33:43 user devstack@n-api.service[61853]: X-User-Id: d932e5d83a9c41ce9518925b68de294d Apr 12 09:33:43 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1479647676-project-member Apr 12 09:33:43 user devstack@n-api.service[61853]: method: Apr 12 09:33:43 user devstack@n-api.service[61853]: exception: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61853]: action_args: {'id': 'd796fe18-c919-4aff-a22e-eded1b66fbf2'} Apr 12 09:33:43 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. (HTTP 404) (Request-ID: req-41f08c46-0a1a-493a-9f5b-d1dffbc9d114) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. Apr 12 09:33:43 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:33:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c0e0a07a-7e9d-4efc-a480-8289c059bff4 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] Returning 404 to user: Volume d796fe18-c919-4aff-a22e-eded1b66fbf2 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:33:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c0e0a07a-7e9d-4efc-a480-8289c059bff4 tempest-VolumesSnapshotsTestJSON-1479647676 tempest-VolumesSnapshotsTestJSON-1479647676-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2" status: 404 len: 109 microversion: 2.1 time: 0.034978 Apr 12 09:33:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 304/908] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:33:43 2023] GET /compute/v2.1/os-volumes/d796fe18-c919-4aff-a22e-eded1b66fbf2 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:33:53 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:33:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b65122bf-1350-4a28-b072-d82d377a78f6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 200 len: 1392 microversion: 2.1 time: 0.162426 Apr 12 09:33:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 305/909] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:33:53 2023] GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:34:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a5efb035-8a90-44ca-bfdf-b403448feb1e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1647623120", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "destination_type": "local"}, {"source_type": "volume", "uuid": "188a81a1-257a-4763-a989-ce70bb6f2c3e", "destination_type": "invalid"}], "networks": [{"uuid": "bbc0bb34-7666-4c19-b2a4-d272ba7af767"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a5efb035-8a90-44ca-bfdf-b403448feb1e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Request method failure captured: Apr 12 09:34:30 user devstack@n-api.service[61855]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 09:34:30 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:34:30 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:34:30 user devstack@n-api.service[61855]: Connection: close Apr 12 09:34:30 user devstack@n-api.service[61855]: Content-Length: 494 Apr 12 09:34:30 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:34:30 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:34:30 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:34:30 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnldkX6cuIUfGfQjkwyt3iiOpls52K7N63eFyEWt1EPPbwOjFrPuBFzO-TkKLFl2ZzR3s51zbOBa7nwRGsbXeY-MSr5LDo2HpRTaKEsjPZHrzHsKktLTAAp35e3aht3rniU-T01ZSZKOxpId-GPRFYSn3wOjhQfAfBLSXxm1aTnfo58 Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Project-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Project-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}] Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Tenant: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Tenant-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:34:30 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:34:30 user devstack@n-api.service[61855]: X-User: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:34:30 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:34:30 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:34:30 user devstack@n-api.service[61855]: X-User-Id: 741e227a2cc7425d8b171c2a04989191 Apr 12 09:34:30 user devstack@n-api.service[61855]: X-User-Name: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:34:30 user devstack@n-api.service[61855]: Apr 12 09:34:30 user devstack@n-api.service[61855]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1647623120", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "destination_type": "local"}, {"source_type": "volume", "uuid": "188a81a1-257a-4763-a989-ce70bb6f2c3e", "destination_type": "invalid"}], "networks": [{"uuid": "bbc0bb34-7666-4c19-b2a4-d272ba7af767"}]}} Apr 12 09:34:30 user devstack@n-api.service[61855]: method: > Apr 12 09:34:30 user devstack@n-api.service[61855]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 09:34:30 user devstack@n-api.service[61855]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1647623120', 'imageRef': '4a835d20-3733-4a8b-bebd-54dfa6135dd6', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '4a835d20-3733-4a8b-bebd-54dfa6135dd6', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '188a81a1-257a-4763-a989-ce70bb6f2c3e', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'bbc0bb34-7666-4c19-b2a4-d272ba7af767'}]}}} Apr 12 09:34:30 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise error Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 09:34:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:34:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-a5efb035-8a90-44ca-bfdf-b403448feb1e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:34:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-a5efb035-8a90-44ca-bfdf-b403448feb1e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.015805 Apr 12 09:34:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 301/910] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:34:30 2023] POST /compute/v2.1/servers => generated 155 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:31 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:34:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9990beeb-e193-44e1-a75d-4da5aa0b05e0 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 200 len: 1494 microversion: 2.1 time: 0.150575 Apr 12 09:34:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 305/911] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:34:30 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 1494 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:34:44 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:34:44 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:34:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-819574104", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:44 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] validate_networks() for [('ddff0553-08b4-42f5-b9ab-cc1d48b41cc5', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Getting quotas for project 335f10fd7d6d4ccaae33d43e406eba03. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Getting quotas for user 6db9d274ddb5416f9f3b18de682dab1b and project 335f10fd7d6d4ccaae33d43e406eba03. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:34:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:34:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.746756 Apr 12 09:34:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 306/912] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:34:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:34:45 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-c8a7310c-5bd7-4a4b-a6fb-6ad4f18f477b tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:34:45 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-c8a7310c-5bd7-4a4b-a6fb-6ad4f18f477b tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:34:45 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-c8a7310c-5bd7-4a4b-a6fb-6ad4f18f477b tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db9d274ddb5416f9f3b18de682dab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f10fd7d6d4ccaae33d43e406eba03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:34:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-c8a7310c-5bd7-4a4b-a6fb-6ad4f18f477b tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db" status: 200 len: 1207 microversion: 2.1 time: 0.133155 Apr 12 09:34:45 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 302/913] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:34:45 2023] GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db => generated 1207 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:34:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a191c232-c08d-498c-9f1d-5314d7c4f7db", "tag": "b325a09c-c4b3-4d26-994b-809fbc14c389"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:34:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:34:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Creating event network-changed:b325a09c-c4b3-4d26-994b-809fbc14c389 for instance a191c232-c08d-498c-9f1d-5314d7c4f7db on user Apr 12 09:34:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033753 Apr 12 09:34:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 306/914] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:34:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a191c232-c08d-498c-9f1d-5314d7c4f7db", "name": "network-vif-plugged", "status": "completed", "tag": "b325a09c-c4b3-4d26-994b-809fbc14c389"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Creating event network-vif-plugged:b325a09c-c4b3-4d26-994b-809fbc14c389 for instance a191c232-c08d-498c-9f1d-5314d7c4f7db on user Apr 12 09:34:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286423 Apr 12 09:34:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 307/915] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:34:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:34:52 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a191c232-c08d-498c-9f1d-5314d7c4f7db", "name": "network-vif-plugged", "status": "completed", "tag": "b325a09c-c4b3-4d26-994b-809fbc14c389"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:52 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Creating event network-vif-plugged:b325a09c-c4b3-4d26-994b-809fbc14c389 for instance a191c232-c08d-498c-9f1d-5314d7c4f7db on user Apr 12 09:34:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Apr 12 09:34:52 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 303/916] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:34:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:53 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:34:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8a8407c1-6f8e-409b-993e-1f7c29901197 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 200 len: 1392 microversion: 2.1 time: 0.145735 Apr 12 09:34:53 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 307/917] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:34:53 2023] GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 1392 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1893081129"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:53 user devstack@n-api.service[61854]: INFO nova.compute.api [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Attempting to quiesce instance before volume snapshot. Apr 12 09:34:54 user devstack@n-api.service[61854]: INFO nova.compute.api [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 09:34:54 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Creating snapshot from volume 8004e131-a0ca-4d62-9c3b-2d379228886e. {{(pid=61854) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 09:34:55 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:34:55 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:34:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-728df84b-c044-403f-b796-91a3b71bc2cc tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf/action" status: 202 len: 0 microversion: 2.1 time: 3.179857 Apr 12 09:34:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 308/918] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:34:53 2023] POST /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf/action => generated 0 bytes in 3182 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-792846810", "imageRef": "f105e0a1-6ab2-4270-ae66-5e2236b2f412", "flavorRef": "42", "networks": [{"uuid": "04d87eab-eb0c-4ca0-b654-941b5fb8be90"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] validate_networks() for [('04d87eab-eb0c-4ca0-b654-941b5fb8be90', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for user 4d3fba65a6ff4e73addd3ec6cdbb08cf and project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:34:57 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c795d11c-a3d9-415c-802d-90f74527425b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:34:57 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.509093 Apr 12 09:34:57 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 304/919] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:34:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:34:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6fb62b03-8c47-4876-899d-2a240bf70c4a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:34:57 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6fb62b03-8c47-4876-899d-2a240bf70c4a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:34:57 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6fb62b03-8c47-4876-899d-2a240bf70c4a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:34:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6fb62b03-8c47-4876-899d-2a240bf70c4a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 200 len: 1223 microversion: 2.1 time: 0.072111 Apr 12 09:34:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 308/920] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:34:57 2023] GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 1223 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:34:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6", "tag": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:34:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:34:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:34:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:34:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Creating event network-changed:5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 on user Apr 12 09:34:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031863 Apr 12 09:34:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 309/921] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6", "name": "network-vif-plugged", "status": "completed", "tag": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Creating event network-vif-plugged:5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 on user Apr 12 09:35:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039079 Apr 12 09:35:12 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 305/922] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:35:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:35:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6", "name": "network-vif-plugged", "status": "completed", "tag": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:35:14 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:14 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:14 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Creating event network-vif-plugged:5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 on user Apr 12 09:35:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035031 Apr 12 09:35:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 309/923] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:35:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db9d274ddb5416f9f3b18de682dab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f10fd7d6d4ccaae33d43e406eba03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:35:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-706fb38a-b2ee-45b5-ba95-5e7ab494ea6f tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db" status: 200 len: 1484 microversion: 2.1 time: 0.179357 Apr 12 09:35:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 310/924] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:35:35 2023] GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db => generated 1484 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] HTTP exception thrown: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Request method failure captured: Apr 12 09:35:35 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c HTTP/1.1 Apr 12 09:35:35 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:35:35 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:35:35 user devstack@n-api.service[61855]: Connection: close Apr 12 09:35:35 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:35:35 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:35:35 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:35:35 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:35:35 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnldkX6cuIUfGfQjkwyt3iiOpls52K7N63eFyEWt1EPPbwOjFrPuBFzO-TkKLFl2ZzR3s51zbOBa7nwRGsbXeY-MSr5LDo2HpRTaKEsjPZHrzHsKktLTAAp35e3aht3rniU-T01ZSZKOxpId-GPRFYSn3wOjhQfAfBLSXxm1aTnfo58 Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Project-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Project-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}] Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Tenant: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Tenant-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:35:35 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:35:35 user devstack@n-api.service[61855]: X-User: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:35:35 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:35:35 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:35:35 user devstack@n-api.service[61855]: X-User-Id: 741e227a2cc7425d8b171c2a04989191 Apr 12 09:35:35 user devstack@n-api.service[61855]: X-User-Name: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:35:35 user devstack@n-api.service[61855]: method: > Apr 12 09:35:35 user devstack@n-api.service[61855]: exception: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61855]: action_args: {'id': '57fc5db7-8577-4a55-a511-d9f25db0a43c'} Apr 12 09:35:35 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Returning 404 to user: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:35:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-cbfb6a9f-de2b-448b-8940-044b5c85c701 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c" status: 404 len: 111 microversion: 2.1 time: 0.034712 Apr 12 09:35:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 306/925] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:35:35 2023] DELETE /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] HTTP exception thrown: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Request method failure captured: Apr 12 09:35:35 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c HTTP/1.1 Apr 12 09:35:35 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:35:35 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:35:35 user devstack@n-api.service[61853]: Connection: close Apr 12 09:35:35 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:35:35 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:35:35 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:35:35 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:35:35 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnldkX6cuIUfGfQjkwyt3iiOpls52K7N63eFyEWt1EPPbwOjFrPuBFzO-TkKLFl2ZzR3s51zbOBa7nwRGsbXeY-MSr5LDo2HpRTaKEsjPZHrzHsKktLTAAp35e3aht3rniU-T01ZSZKOxpId-GPRFYSn3wOjhQfAfBLSXxm1aTnfo58 Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Project-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}] Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Tenant: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Tenant-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:35:35 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:35:35 user devstack@n-api.service[61853]: X-User: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:35:35 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:35:35 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:35:35 user devstack@n-api.service[61853]: X-User-Id: 741e227a2cc7425d8b171c2a04989191 Apr 12 09:35:35 user devstack@n-api.service[61853]: X-User-Name: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:35:35 user devstack@n-api.service[61853]: method: > Apr 12 09:35:35 user devstack@n-api.service[61853]: exception: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61853]: action_args: {'id': '57fc5db7-8577-4a55-a511-d9f25db0a43c'} Apr 12 09:35:35 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. Apr 12 09:35:35 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:35:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Returning 404 to user: Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:35:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-10d50951-7c00-404b-9e13-6b0081051da8 tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c" status: 404 len: 111 microversion: 2.1 time: 0.035472 Apr 12 09:35:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 310/926] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:35:35 2023] GET /compute/v2.1/servers/57fc5db7-8577-4a55-a511-d9f25db0a43c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:35:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 204 len: 0 microversion: 2.1 time: 0.110831 Apr 12 09:35:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 311/927] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:35:35 2023] DELETE /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:35 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:35:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-65030275-192a-4ee0-b135-332d5721bf9a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 200 len: 1500 microversion: 2.1 time: 0.301996 Apr 12 09:35:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 307/928] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:35:35 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 1500 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:35:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ed5717-a2c5-469a-b1c8-2577b4debc2f", "name": "network-vif-unplugged", "status": "completed", "tag": "267e3243-9c0f-454c-a691-ee2d1f4fcddf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:35:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Creating event network-vif-unplugged:267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f on user Apr 12 09:35:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082331 Apr 12 09:35:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 311/929] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:35:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-eabb01ca-7825-48ac-a128-7cf1e90209b7 req-998f0dd7-8832-430d-8262-70fe4b44f365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ed5717-a2c5-469a-b1c8-2577b4debc2f", "name": "network-vif-deleted", "tag": "267e3243-9c0f-454c-a691-ee2d1f4fcddf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:35:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-eabb01ca-7825-48ac-a128-7cf1e90209b7 req-998f0dd7-8832-430d-8262-70fe4b44f365 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-eabb01ca-7825-48ac-a128-7cf1e90209b7 req-998f0dd7-8832-430d-8262-70fe4b44f365 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-eabb01ca-7825-48ac-a128-7cf1e90209b7 req-998f0dd7-8832-430d-8262-70fe4b44f365 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-eabb01ca-7825-48ac-a128-7cf1e90209b7 req-998f0dd7-8832-430d-8262-70fe4b44f365 service nova] Creating event network-vif-deleted:267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f on user Apr 12 09:35:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-eabb01ca-7825-48ac-a128-7cf1e90209b7 req-998f0dd7-8832-430d-8262-70fe4b44f365 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081448 Apr 12 09:35:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 312/930] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:35:38 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ed5717-a2c5-469a-b1c8-2577b4debc2f", "name": "network-vif-plugged", "status": "completed", "tag": "267e3243-9c0f-454c-a691-ee2d1f4fcddf"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:35:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:38 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Creating event network-vif-plugged:267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f on user Apr 12 09:35:38 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Apr 12 09:35:38 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 308/931] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:35:47 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:35:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c143bc58-e0be-49ec-9553-ce2081034a85 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 200 len: 1551 microversion: 2.1 time: 0.212069 Apr 12 09:35:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 312/932] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:35:47 2023] GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 1551 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] HTTP exception thrown: Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f could not be found. Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Request method failure captured: Apr 12 09:36:26 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f HTTP/1.1 Apr 12 09:36:26 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:36:26 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:36:26 user devstack@n-api.service[61854]: Connection: close Apr 12 09:36:26 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:36:26 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:36:26 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:36:26 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:36:26 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnldkX6cuIUfGfQjkwyt3iiOpls52K7N63eFyEWt1EPPbwOjFrPuBFzO-TkKLFl2ZzR3s51zbOBa7nwRGsbXeY-MSr5LDo2HpRTaKEsjPZHrzHsKktLTAAp35e3aht3rniU-T01ZSZKOxpId-GPRFYSn3wOjhQfAfBLSXxm1aTnfo58 Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Project-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dcea1b997ee6450dbf603305d2812f7f"}]}] Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Tenant: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Tenant-Id: dcea1b997ee6450dbf603305d2812f7f Apr 12 09:36:26 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848567648 Apr 12 09:36:26 user devstack@n-api.service[61854]: X-User: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:36:26 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:36:26 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:36:26 user devstack@n-api.service[61854]: X-User-Id: 741e227a2cc7425d8b171c2a04989191 Apr 12 09:36:26 user devstack@n-api.service[61854]: X-User-Name: tempest-ServersNegativeTestJSON-1848567648-project-member Apr 12 09:36:26 user devstack@n-api.service[61854]: method: > Apr 12 09:36:26 user devstack@n-api.service[61854]: exception: Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f could not be found. Apr 12 09:36:26 user devstack@n-api.service[61854]: action_args: {'id': '16ed5717-a2c5-469a-b1c8-2577b4debc2f'} Apr 12 09:36:26 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f could not be found. Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f could not be found. Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f could not be found. Apr 12 09:36:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Returning 404 to user: Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:36:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9b35f729-05dd-4935-b366-90ff3360770a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f" status: 404 len: 111 microversion: 2.1 time: 0.049987 Apr 12 09:36:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 313/933] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:36:26 2023] GET /compute/v2.1/servers/16ed5717-a2c5-469a-b1c8-2577b4debc2f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-94810236-4663-49f7-8761-27d728bddf5f tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b796f80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1936011834", "metadata": {"Type": "work"}}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-94810236-4663-49f7-8761-27d728bddf5f tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Request method failure captured: Apr 12 09:36:30 user devstack@n-api.service[61855]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 09:36:30 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:36:30 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:36:30 user devstack@n-api.service[61855]: Connection: close Apr 12 09:36:30 user devstack@n-api.service[61855]: Content-Length: 122 Apr 12 09:36:30 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:36:30 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:36:30 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:36:30 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnueioH1c10uaCr13tZmTXop00GsLL0eanEQIArYfsIuoUhUod_ciriy5dCNhKYquiKO-y-8D6qjcXTPzrA7WoxVp856mCyxpzIOjwgp87ilpkLe6UZtWgdL7QylTFaQ4zrjgiq3-WBvu0XHoODwaoAYdxoc2XsP1jQAWsQ-AhbxgRY Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}] Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Id: 31ecec1a9e1f4f37bd72bed16e7e8202 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Name: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61855]: Apr 12 09:36:30 user devstack@n-api.service[61855]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1936011834", "metadata": {"Type": "work"}}} Apr 12 09:36:30 user devstack@n-api.service[61855]: method: Apr 12 09:36:30 user devstack@n-api.service[61855]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61855]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1936011834', 'metadata': {'Type': 'work'}}}} Apr 12 09:36:30 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise error Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-94810236-4663-49f7-8761-27d728bddf5f tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:36:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-94810236-4663-49f7-8761-27d728bddf5f tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.204120 Apr 12 09:36:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 309/934] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 09:36:30 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-46003735-5f98-4c91-a5bb-c30186bc9080 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b9a5bd0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1402378858", "metadata": {"Type": "work"}}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-46003735-5f98-4c91-a5bb-c30186bc9080 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Request method failure captured: Apr 12 09:36:30 user devstack@n-api.service[61853]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 09:36:30 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:36:30 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:36:30 user devstack@n-api.service[61853]: Connection: close Apr 12 09:36:30 user devstack@n-api.service[61853]: Content-Length: 120 Apr 12 09:36:30 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:36:30 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:36:30 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:36:30 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnueioH1c10uaCr13tZmTXop00GsLL0eanEQIArYfsIuoUhUod_ciriy5dCNhKYquiKO-y-8D6qjcXTPzrA7WoxVp856mCyxpzIOjwgp87ilpkLe6UZtWgdL7QylTFaQ4zrjgiq3-WBvu0XHoODwaoAYdxoc2XsP1jQAWsQ-AhbxgRY Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}] Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Tenant-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Id: 31ecec1a9e1f4f37bd72bed16e7e8202 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61853]: Apr 12 09:36:30 user devstack@n-api.service[61853]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1402378858", "metadata": {"Type": "work"}}} Apr 12 09:36:30 user devstack@n-api.service[61853]: method: Apr 12 09:36:30 user devstack@n-api.service[61853]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 09:36:30 user devstack@n-api.service[61853]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1402378858', 'metadata': {'Type': 'work'}}}} Apr 12 09:36:30 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise error Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi '0' Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-46003735-5f98-4c91-a5bb-c30186bc9080 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:36:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-46003735-5f98-4c91-a5bb-c30186bc9080 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010369 Apr 12 09:36:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 313/935] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 09:36:30 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7265db11-bcec-47c6-b2fd-1c0265558203 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b803400>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1614225700", "metadata": {"Type": "work"}}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:36:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7265db11-bcec-47c6-b2fd-1c0265558203 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Request method failure captured: Apr 12 09:36:30 user devstack@n-api.service[61854]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 09:36:30 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:36:30 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:36:30 user devstack@n-api.service[61854]: Connection: close Apr 12 09:36:30 user devstack@n-api.service[61854]: Content-Length: 119 Apr 12 09:36:30 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:36:30 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:36:30 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:36:30 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnueioH1c10uaCr13tZmTXop00GsLL0eanEQIArYfsIuoUhUod_ciriy5dCNhKYquiKO-y-8D6qjcXTPzrA7WoxVp856mCyxpzIOjwgp87ilpkLe6UZtWgdL7QylTFaQ4zrjgiq3-WBvu0XHoODwaoAYdxoc2XsP1jQAWsQ-AhbxgRY Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Project-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}] Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Tenant-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61854]: X-User: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61854]: X-User-Id: 31ecec1a9e1f4f37bd72bed16e7e8202 Apr 12 09:36:30 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61854]: Apr 12 09:36:30 user devstack@n-api.service[61854]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1614225700", "metadata": {"Type": "work"}}} Apr 12 09:36:30 user devstack@n-api.service[61854]: method: Apr 12 09:36:30 user devstack@n-api.service[61854]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61854]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1614225700', 'metadata': {'Type': 'work'}}}} Apr 12 09:36:30 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise error Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi '' Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 09:36:30 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7265db11-bcec-47c6-b2fd-1c0265558203 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:36:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7265db11-bcec-47c6-b2fd-1c0265558203 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010699 Apr 12 09:36:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 314/936] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 09:36:30 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-5ce268bd-b27e-468a-bcf5-c759269d319c tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Calling method '.version_select at 0x7fbd5b796c20>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-5ce268bd-b27e-468a-bcf5-c759269d319c tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] HTTP exception thrown: Volume tempest-invalid-2106337592 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-5ce268bd-b27e-468a-bcf5-c759269d319c tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Request method failure captured: Apr 12 09:36:30 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2106337592 HTTP/1.1 Apr 12 09:36:30 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:36:30 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:36:30 user devstack@n-api.service[61855]: Connection: close Apr 12 09:36:30 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:36:30 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:36:30 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:36:30 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:36:30 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnueioH1c10uaCr13tZmTXop00GsLL0eanEQIArYfsIuoUhUod_ciriy5dCNhKYquiKO-y-8D6qjcXTPzrA7WoxVp856mCyxpzIOjwgp87ilpkLe6UZtWgdL7QylTFaQ4zrjgiq3-WBvu0XHoODwaoAYdxoc2XsP1jQAWsQ-AhbxgRY Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}] Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Id: 31ecec1a9e1f4f37bd72bed16e7e8202 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Name: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61855]: method: Apr 12 09:36:30 user devstack@n-api.service[61855]: exception: Volume tempest-invalid-2106337592 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: action_args: {'id': 'tempest-invalid-2106337592'} Apr 12 09:36:30 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2106337592 could not be found. (HTTP 404) (Request-ID: req-8128c939-f70a-4b79-a215-d9c080cbcd61) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2106337592 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2106337592 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2106337592 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-5ce268bd-b27e-468a-bcf5-c759269d319c tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Returning 404 to user: Volume tempest-invalid-2106337592 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:36:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-5ce268bd-b27e-468a-bcf5-c759269d319c tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2106337592" status: 404 len: 99 microversion: 2.1 time: 0.037489 Apr 12 09:36:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 310/937] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 09:36:30 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-2106337592 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-33a45890-d706-43dd-bce2-14c27872362d tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003593 Apr 12 09:36:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 314/938] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 09:36:30 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f617d8a3-5866-42f7-beb8-d7f55a585f60 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004452 Apr 12 09:36:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 315/939] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 09:36:30 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-aea12153-e25c-4723-8728-aaa1e4c57c48 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Calling method '.version_select at 0x7fbd5b7d6050>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-aea12153-e25c-4723-8728-aaa1e4c57c48 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] HTTP exception thrown: Volume 49ec0bc2-464e-43ce-a68a-241161c02cc4 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-aea12153-e25c-4723-8728-aaa1e4c57c48 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Request method failure captured: Apr 12 09:36:30 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/os-volumes/49ec0bc2-464e-43ce-a68a-241161c02cc4 HTTP/1.1 Apr 12 09:36:30 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:36:30 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:36:30 user devstack@n-api.service[61855]: Connection: close Apr 12 09:36:30 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:36:30 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:36:30 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:36:30 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:36:30 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnueioH1c10uaCr13tZmTXop00GsLL0eanEQIArYfsIuoUhUod_ciriy5dCNhKYquiKO-y-8D6qjcXTPzrA7WoxVp856mCyxpzIOjwgp87ilpkLe6UZtWgdL7QylTFaQ4zrjgiq3-WBvu0XHoODwaoAYdxoc2XsP1jQAWsQ-AhbxgRY Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Project-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}] Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Id: 31ecec1a9e1f4f37bd72bed16e7e8202 Apr 12 09:36:30 user devstack@n-api.service[61855]: X-User-Name: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61855]: method: Apr 12 09:36:30 user devstack@n-api.service[61855]: exception: Volume 49ec0bc2-464e-43ce-a68a-241161c02cc4 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: action_args: {'id': '49ec0bc2-464e-43ce-a68a-241161c02cc4'} Apr 12 09:36:30 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49ec0bc2-464e-43ce-a68a-241161c02cc4 could not be found. (HTTP 404) (Request-ID: req-4dea0f5f-3036-4ec9-9552-7d2b7e3556df) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49ec0bc2-464e-43ce-a68a-241161c02cc4 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49ec0bc2-464e-43ce-a68a-241161c02cc4 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49ec0bc2-464e-43ce-a68a-241161c02cc4 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-aea12153-e25c-4723-8728-aaa1e4c57c48 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Returning 404 to user: Volume 49ec0bc2-464e-43ce-a68a-241161c02cc4 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:36:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-aea12153-e25c-4723-8728-aaa1e4c57c48 tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/49ec0bc2-464e-43ce-a68a-241161c02cc4" status: 404 len: 109 microversion: 2.1 time: 0.037042 Apr 12 09:36:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 311/940] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 09:36:30 2023] DELETE /compute/v2.1/os-volumes/49ec0bc2-464e-43ce-a68a-241161c02cc4 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3d7c7bad-6bae-4a26-a836-e8dc22cfefed tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Calling method '.version_select at 0x7fbd5b8b6560>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:36:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-3d7c7bad-6bae-4a26-a836-e8dc22cfefed tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] HTTP exception thrown: Volume 3a440832-747f-45e3-aefe-d026e90b9529 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3d7c7bad-6bae-4a26-a836-e8dc22cfefed tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Request method failure captured: Apr 12 09:36:30 user devstack@n-api.service[61853]: request: GET /compute/v2.1/os-volumes/3a440832-747f-45e3-aefe-d026e90b9529 HTTP/1.1 Apr 12 09:36:30 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:36:30 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:36:30 user devstack@n-api.service[61853]: Connection: close Apr 12 09:36:30 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:36:30 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:36:30 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:36:30 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:36:30 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnueioH1c10uaCr13tZmTXop00GsLL0eanEQIArYfsIuoUhUod_ciriy5dCNhKYquiKO-y-8D6qjcXTPzrA7WoxVp856mCyxpzIOjwgp87ilpkLe6UZtWgdL7QylTFaQ4zrjgiq3-WBvu0XHoODwaoAYdxoc2XsP1jQAWsQ-AhbxgRY Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b81844c9c90c44598f8f8ea5a6f10cae"}]}] Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Tenant-Id: b81844c9c90c44598f8f8ea5a6f10cae Apr 12 09:36:30 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesNegativeTest-786000027 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Id: 31ecec1a9e1f4f37bd72bed16e7e8202 Apr 12 09:36:30 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesNegativeTest-786000027-project-member Apr 12 09:36:30 user devstack@n-api.service[61853]: method: Apr 12 09:36:30 user devstack@n-api.service[61853]: exception: Volume 3a440832-747f-45e3-aefe-d026e90b9529 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61853]: action_args: {'id': '3a440832-747f-45e3-aefe-d026e90b9529'} Apr 12 09:36:30 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a440832-747f-45e3-aefe-d026e90b9529 could not be found. (HTTP 404) (Request-ID: req-788fa76d-a30f-44e7-bdcc-07232323328e) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a440832-747f-45e3-aefe-d026e90b9529 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a440832-747f-45e3-aefe-d026e90b9529 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a440832-747f-45e3-aefe-d026e90b9529 could not be found. Apr 12 09:36:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:36:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3d7c7bad-6bae-4a26-a836-e8dc22cfefed tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] Returning 404 to user: Volume 3a440832-747f-45e3-aefe-d026e90b9529 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:36:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3d7c7bad-6bae-4a26-a836-e8dc22cfefed tempest-VolumesNegativeTest-786000027 tempest-VolumesNegativeTest-786000027-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3a440832-747f-45e3-aefe-d026e90b9529" status: 404 len: 109 microversion: 2.1 time: 0.035515 Apr 12 09:36:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 315/941] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 09:36:30 2023] GET /compute/v2.1/os-volumes/3a440832-747f-45e3-aefe-d026e90b9529 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:36:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db" status: 204 len: 0 microversion: 2.1 time: 0.166392 Apr 12 09:36:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 316/942] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:36:40 2023] DELETE /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a191c232-c08d-498c-9f1d-5314d7c4f7db", "name": "network-vif-unplugged", "status": "completed", "tag": "b325a09c-c4b3-4d26-994b-809fbc14c389"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:36:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Creating event network-vif-unplugged:b325a09c-c4b3-4d26-994b-809fbc14c389 for instance a191c232-c08d-498c-9f1d-5314d7c4f7db on user Apr 12 09:36:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029046 Apr 12 09:36:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 316/943] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:36:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:36:41 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db9d274ddb5416f9f3b18de682dab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f10fd7d6d4ccaae33d43e406eba03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:36:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-38d04d71-c536-4757-9f8f-0020358fd776 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db" status: 200 len: 1490 microversion: 2.1 time: 0.568907 Apr 12 09:36:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 312/944] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:36:40 2023] GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db => generated 1490 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:36:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a191c232-c08d-498c-9f1d-5314d7c4f7db", "name": "network-vif-plugged", "status": "completed", "tag": "b325a09c-c4b3-4d26-994b-809fbc14c389"}, {"server_uuid": "a191c232-c08d-498c-9f1d-5314d7c4f7db", "name": "network-vif-deleted", "tag": "b325a09c-c4b3-4d26-994b-809fbc14c389"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Creating event network-vif-plugged:b325a09c-c4b3-4d26-994b-809fbc14c389 for instance a191c232-c08d-498c-9f1d-5314d7c4f7db on user Apr 12 09:36:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Creating event network-vif-deleted:b325a09c-c4b3-4d26-994b-809fbc14c389 for instance a191c232-c08d-498c-9f1d-5314d7c4f7db on user Apr 12 09:36:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037503 Apr 12 09:36:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 317/945] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:36:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:36:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:36:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-21e9fc42-a9da-4836-a5fd-78235240849d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 200 len: 1551 microversion: 2.1 time: 0.141433 Apr 12 09:36:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 317/946] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:36:47 2023] GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 1551 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:48 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:36:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 204 len: 0 microversion: 2.1 time: 0.107253 Apr 12 09:36:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 313/947] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:36:48 2023] DELETE /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:48 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:36:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-daa8d228-680c-42c1-b645-ee6c5049dfb3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 200 len: 1557 microversion: 2.1 time: 0.168885 Apr 12 09:36:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 318/948] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:36:48 2023] GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6", "name": "network-vif-unplugged", "status": "completed", "tag": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Creating event network-vif-unplugged:5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 on user Apr 12 09:36:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031197 Apr 12 09:36:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 318/949] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:36:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:36:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6", "name": "network-vif-plugged", "status": "completed", "tag": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888"}, {"server_uuid": "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6", "name": "network-vif-deleted", "tag": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:36:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:36:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:36:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:36:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Creating event network-vif-plugged:5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 on user Apr 12 09:36:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Creating event network-vif-deleted:5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 on user Apr 12 09:36:50 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032563 Apr 12 09:36:50 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 314/950] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:37:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2125995582", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "48a4a967-0639-4505-a467-85bc73b75a4c"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:37:15 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:15 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:15 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] validate_networks() for [('48a4a967-0639-4505-a467-85bc73b75a4c', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting quotas for project 5b7b1c70322c4f31a30e0294291aa165. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting quotas for user 7b2402ddb2264bc19341580cc719c706 and project 5b7b1c70322c4f31a30e0294291aa165. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:37:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:37:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.491517 Apr 12 09:37:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 319/951] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:37:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:37:16 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:16 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6a0eecf4-a8fd-42b0-aba0-de79328b9705 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:37:16 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6a0eecf4-a8fd-42b0-aba0-de79328b9705 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:37:16 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6a0eecf4-a8fd-42b0-aba0-de79328b9705 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:37:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6a0eecf4-a8fd-42b0-aba0-de79328b9705 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982" status: 200 len: 1213 microversion: 2.1 time: 0.078080 Apr 12 09:37:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 319/952] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:37:16 2023] GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:37:18 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:18 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:18 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4bf54e3-c4cd-4f1e-a0c3-eec827238982", "tag": "8c15ba29-fa31-4056-a248-840557a7a18a"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:37:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:18 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:18 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Creating event network-changed:8c15ba29-fa31-4056-a248-840557a7a18a for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 on user Apr 12 09:37:18 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039211 Apr 12 09:37:18 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 315/953] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:37:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:37:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bf54e3-c4cd-4f1e-a0c3-eec827238982", "name": "network-vif-plugged", "status": "completed", "tag": "8c15ba29-fa31-4056-a248-840557a7a18a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:37:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Creating event network-vif-plugged:8c15ba29-fa31-4056-a248-840557a7a18a for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 on user Apr 12 09:37:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060088 Apr 12 09:37:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 320/954] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:37:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bf54e3-c4cd-4f1e-a0c3-eec827238982", "name": "network-vif-plugged", "status": "completed", "tag": "8c15ba29-fa31-4056-a248-840557a7a18a"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:37:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Creating event network-vif-plugged:8c15ba29-fa31-4056-a248-840557a7a18a for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 on user Apr 12 09:37:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032150 Apr 12 09:37:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 320/955] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] HTTP exception thrown: Instance a191c232-c08d-498c-9f1d-5314d7c4f7db could not be found. Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Request method failure captured: Apr 12 09:37:31 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db HTTP/1.1 Apr 12 09:37:31 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:37:31 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:37:31 user devstack@n-api.service[61855]: Connection: close Apr 12 09:37:31 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:37:31 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:37:31 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:37:31 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:37:31 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnsyugm_xceb3PmdZ0LuWto0AmX_sQnd66Rr5pmJB2JSLZ6Vbyx8BNbtFJPaW3YT5wOLvLKfxVIHtcPUWsgOWIo0be0k11kYFfzeGsNqCyl_2TgIVH3Pyjm-XfjYFhvkSgWzg7Hd32l0LoKfLhVeLjMCcbr45MKCEEVxjqv37VkVs_o Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Project-Id: 335f10fd7d6d4ccaae33d43e406eba03 Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Project-Name: tempest-VolumesActionsTest-650670230 Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/335f10fd7d6d4ccaae33d43e406eba03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/335f10fd7d6d4ccaae33d43e406eba03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/335f10fd7d6d4ccaae33d43e406eba03"}]}] Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Tenant: tempest-VolumesActionsTest-650670230 Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Tenant-Id: 335f10fd7d6d4ccaae33d43e406eba03 Apr 12 09:37:31 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-VolumesActionsTest-650670230 Apr 12 09:37:31 user devstack@n-api.service[61855]: X-User: tempest-VolumesActionsTest-650670230-project-member Apr 12 09:37:31 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:37:31 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:37:31 user devstack@n-api.service[61855]: X-User-Id: 6db9d274ddb5416f9f3b18de682dab1b Apr 12 09:37:31 user devstack@n-api.service[61855]: X-User-Name: tempest-VolumesActionsTest-650670230-project-member Apr 12 09:37:31 user devstack@n-api.service[61855]: method: > Apr 12 09:37:31 user devstack@n-api.service[61855]: exception: Instance a191c232-c08d-498c-9f1d-5314d7c4f7db could not be found. Apr 12 09:37:31 user devstack@n-api.service[61855]: action_args: {'id': 'a191c232-c08d-498c-9f1d-5314d7c4f7db'} Apr 12 09:37:31 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a191c232-c08d-498c-9f1d-5314d7c4f7db could not be found. Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a191c232-c08d-498c-9f1d-5314d7c4f7db could not be found. Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a191c232-c08d-498c-9f1d-5314d7c4f7db could not be found. Apr 12 09:37:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:37:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Returning 404 to user: Instance a191c232-c08d-498c-9f1d-5314d7c4f7db could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:37:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-2aa13d4e-3d5c-4e2e-a2ae-81e2d9682556 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db" status: 404 len: 111 microversion: 2.1 time: 0.030438 Apr 12 09:37:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 316/956] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:37:31 2023] GET /compute/v2.1/servers/a191c232-c08d-498c-9f1d-5314d7c4f7db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:37:38 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 HTTP/1.1 Apr 12 09:37:38 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:37:38 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:37:38 user devstack@n-api.service[61854]: Connection: close Apr 12 09:37:38 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:37:38 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:37:38 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:37:38 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:37:38 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:37:38 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:37:38 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:37:38 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:37:38 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:37:38 user devstack@n-api.service[61854]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:37:38 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:37:38 user devstack@n-api.service[61854]: method: > Apr 12 09:37:38 user devstack@n-api.service[61854]: exception: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:37:38 user devstack@n-api.service[61854]: action_args: {'id': '07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6'} Apr 12 09:37:38 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:37:38 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:37:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:37:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-443294f8-2281-4f7e-be90-bc490bed251b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 404 len: 111 microversion: 2.1 time: 0.044328 Apr 12 09:37:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 321/957] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:37:38 2023] GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:37:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 204 len: 0 microversion: 2.1 time: 0.125282 Apr 12 09:37:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 321/958] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:37:40 2023] DELETE /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:40 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:41 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:37:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-b6b0a974-5f75-4c9c-b571-51ab290710fd tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 200 len: 1398 microversion: 2.1 time: 0.182283 Apr 12 09:37:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 317/959] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:37:40 2023] GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 1398 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:37:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd463b2a-f10b-424a-b199-c8db4aa486bf", "name": "network-vif-unplugged", "status": "completed", "tag": "ccf2d9f7-9747-4452-9248-874c2b8b23cf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:37:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Creating event network-vif-unplugged:ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance cd463b2a-f10b-424a-b199-c8db4aa486bf on user Apr 12 09:37:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028630 Apr 12 09:37:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 322/960] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:37:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:37:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd463b2a-f10b-424a-b199-c8db4aa486bf", "name": "network-vif-plugged", "status": "completed", "tag": "ccf2d9f7-9747-4452-9248-874c2b8b23cf"}, {"server_uuid": "cd463b2a-f10b-424a-b199-c8db4aa486bf", "name": "network-vif-deleted", "tag": "ccf2d9f7-9747-4452-9248-874c2b8b23cf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:37:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:37:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:37:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:37:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Creating event network-vif-plugged:ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance cd463b2a-f10b-424a-b199-c8db4aa486bf on user Apr 12 09:37:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Creating event network-vif-deleted:ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance cd463b2a-f10b-424a-b199-c8db4aa486bf on user Apr 12 09:37:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032634 Apr 12 09:37:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 322/961] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:37:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=8 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:06 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:38:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-bbdf1b22-a16a-4f6b-a7dd-b8e40540502f tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982" status: 200 len: 1496 microversion: 2.1 time: 0.146765 Apr 12 09:38:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 318/962] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:38:06 2023] GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => generated 1496 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:38:31 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf HTTP/1.1 Apr 12 09:38:31 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:38:31 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:38:31 user devstack@n-api.service[61854]: Connection: close Apr 12 09:38:31 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:38:31 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:38:31 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:38:31 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:38:31 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61854]: method: > Apr 12 09:38:31 user devstack@n-api.service[61854]: exception: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: action_args: {'id': 'cd463b2a-f10b-424a-b199-c8db4aa486bf'} Apr 12 09:38:31 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:38:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3552e62d-0ddf-46a0-aeb7-a844f9f90ecb tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 404 len: 111 microversion: 2.1 time: 0.039423 Apr 12 09:38:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 323/963] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:38:31 2023] GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:38:31 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 HTTP/1.1 Apr 12 09:38:31 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:38:31 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:38:31 user devstack@n-api.service[61853]: Connection: close Apr 12 09:38:31 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:38:31 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:38:31 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:38:31 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:38:31 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61853]: method: > Apr 12 09:38:31 user devstack@n-api.service[61853]: exception: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: action_args: {'id': '07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6'} Apr 12 09:38:31 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:38:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5b1f8d19-c2d2-49b0-be3c-cae512262201 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 404 len: 111 microversion: 2.1 time: 0.036175 Apr 12 09:38:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 323/964] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:38:31 2023] DELETE /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:38:31 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 HTTP/1.1 Apr 12 09:38:31 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:38:31 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:38:31 user devstack@n-api.service[61855]: Connection: close Apr 12 09:38:31 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:38:31 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:38:31 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:38:31 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:38:31 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61855]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61855]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:38:31 user devstack@n-api.service[61855]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61855]: method: > Apr 12 09:38:31 user devstack@n-api.service[61855]: exception: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61855]: action_args: {'id': '07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6'} Apr 12 09:38:31 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. Apr 12 09:38:31 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:38:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d5408ccb-113b-41ff-a00b-1202e1c5154c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" status: 404 len: 111 microversion: 2.1 time: 0.034650 Apr 12 09:38:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 319/965] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:38:31 2023] GET /compute/v2.1/servers/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:38:31 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf HTTP/1.1 Apr 12 09:38:31 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:38:31 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:38:31 user devstack@n-api.service[61854]: Connection: close Apr 12 09:38:31 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:38:31 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:38:31 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:38:31 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:38:31 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:38:31 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61854]: method: > Apr 12 09:38:31 user devstack@n-api.service[61854]: exception: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: action_args: {'id': 'cd463b2a-f10b-424a-b199-c8db4aa486bf'} Apr 12 09:38:31 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:38:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-efa93372-2263-40a2-acc2-c115f2e4cf56 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 404 len: 111 microversion: 2.1 time: 0.031511 Apr 12 09:38:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 324/966] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:38:31 2023] DELETE /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:38:31 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf HTTP/1.1 Apr 12 09:38:31 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:38:31 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:38:31 user devstack@n-api.service[61853]: Connection: close Apr 12 09:38:31 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:38:31 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:38:31 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:38:31 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:38:31 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:38:31 user devstack@n-api.service[61853]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:38:31 user devstack@n-api.service[61853]: method: > Apr 12 09:38:31 user devstack@n-api.service[61853]: exception: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: action_args: {'id': 'cd463b2a-f10b-424a-b199-c8db4aa486bf'} Apr 12 09:38:31 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. Apr 12 09:38:31 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:38:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance cd463b2a-f10b-424a-b199-c8db4aa486bf could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:38:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4233e2f6-d4e1-435a-bae5-8e3bf99bd80e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf" status: 404 len: 111 microversion: 2.1 time: 0.048607 Apr 12 09:38:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 324/967] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:38:31 2023] GET /compute/v2.1/servers/cd463b2a-f10b-424a-b199-c8db4aa486bf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-d7018b0f-ee1d-4527-a1f8-8a96cf19c2c6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'create', calling method: .version_select at 0x7fbd5be0c3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-390353875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw=="}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-d7018b0f-ee1d-4527-a1f8-8a96cf19c2c6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for project 1a0437bfee4545949707443636e07b80. Resources: {'key_pairs'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:38:31 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-d7018b0f-ee1d-4527-a1f8-8a96cf19c2c6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for user 4d3fba65a6ff4e73addd3ec6cdbb08cf and project 1a0437bfee4545949707443636e07b80. Resources: {'key_pairs'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:38:31 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-d7018b0f-ee1d-4527-a1f8-8a96cf19c2c6 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.045824 Apr 12 09:38:31 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 320/968] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:38:31 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:38:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1150635585", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-390353875", "security_groups": [{"name": "tempest-secgroup-smoke-837914729"}], "block_device_mapping_v2": [{"uuid": "d1ab1273-9a1f-422c-8d8c-85ec688d5b9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04d87eab-eb0c-4ca0-b654-941b5fb8be90"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:38:35 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] validate_networks() for [('04d87eab-eb0c-4ca0-b654-941b5fb8be90', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for user 4d3fba65a6ff4e73addd3ec6cdbb08cf and project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:38:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1ab1273-9a1f-422c-8d8c-85ec688d5b9a',volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:38:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.771726 Apr 12 09:38:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 325/969] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:38:35 2023] POST /compute/v2.1/servers => generated 403 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:38:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3d37753e-b293-45c3-8ff5-3bd5865e844e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:38:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3d37753e-b293-45c3-8ff5-3bd5865e844e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:38:36 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-3d37753e-b293-45c3-8ff5-3bd5865e844e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:38:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3d37753e-b293-45c3-8ff5-3bd5865e844e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 200 len: 1089 microversion: 2.1 time: 0.072180 Apr 12 09:38:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 325/970] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:38:36 2023] GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:38:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42b12e5-5e85-4206-866f-42294318f0b0", "tag": "725c2a1c-abed-48f3-8fe7-f724a7552bca"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:38:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Creating event network-changed:725c2a1c-abed-48f3-8fe7-f724a7552bca for instance a42b12e5-5e85-4206-866f-42294318f0b0 on user Apr 12 09:38:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029905 Apr 12 09:38:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 321/971] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:38:46 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:46 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:46 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42b12e5-5e85-4206-866f-42294318f0b0", "name": "network-vif-plugged", "status": "completed", "tag": "725c2a1c-abed-48f3-8fe7-f724a7552bca"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:38:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Creating event network-vif-plugged:725c2a1c-abed-48f3-8fe7-f724a7552bca for instance a42b12e5-5e85-4206-866f-42294318f0b0 on user Apr 12 09:38:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268271 Apr 12 09:38:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 326/972] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:38:48 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:48 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:48 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:38:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42b12e5-5e85-4206-866f-42294318f0b0", "name": "network-vif-plugged", "status": "completed", "tag": "725c2a1c-abed-48f3-8fe7-f724a7552bca"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:38:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:38:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:38:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:38:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Creating event network-vif-plugged:725c2a1c-abed-48f3-8fe7-f724a7552bca for instance a42b12e5-5e85-4206-866f-42294318f0b0 on user Apr 12 09:38:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034729 Apr 12 09:38:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 326/973] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:38:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c316b2d-328a-4863-8ee7-b216639e40ab", "device": "/dev/vdb"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:06 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289042 Apr 12 09:39:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 322/974] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:39:06 2023] POST /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'services' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:39:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/os-volume_attachments/2c316b2d-328a-4863-8ee7-b216639e40ab" status: 202 len: 0 microversion: 2.1 time: 0.171624 Apr 12 09:39:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 327/975] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:39:26 2023] DELETE /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/os-volume_attachments/2c316b2d-328a-4863-8ee7-b216639e40ab => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:39:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982" status: 204 len: 0 microversion: 2.1 time: 0.133456 Apr 12 09:39:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 327/976] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:39:26 2023] DELETE /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:26 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:27 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:39:27 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:39:27 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-ad701048-ca04-40a4-907b-3d36dac01d81 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 200 len: 1442 microversion: 2.1 time: 0.249616 Apr 12 09:39:27 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 323/977] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:39:26 2023] GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 1442 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:39:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9281565c-7ca0-45dd-908a-a615f2047b7e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982" status: 200 len: 1548 microversion: 2.1 time: 0.251506 Apr 12 09:39:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 328/978] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:39:26 2023] GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => generated 1548 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:39:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bf54e3-c4cd-4f1e-a0c3-eec827238982", "name": "network-vif-unplugged", "status": "completed", "tag": "8c15ba29-fa31-4056-a248-840557a7a18a"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:39:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Creating event network-vif-unplugged:8c15ba29-fa31-4056-a248-840557a7a18a for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 on user Apr 12 09:39:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033006 Apr 12 09:39:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 328/979] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:39:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:39:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bf54e3-c4cd-4f1e-a0c3-eec827238982", "name": "network-vif-plugged", "status": "completed", "tag": "8c15ba29-fa31-4056-a248-840557a7a18a"}, {"server_uuid": "d4bf54e3-c4cd-4f1e-a0c3-eec827238982", "name": "network-vif-deleted", "tag": "8c15ba29-fa31-4056-a248-840557a7a18a"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:39:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:39:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:39:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:39:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Creating event network-vif-plugged:8c15ba29-fa31-4056-a248-840557a7a18a for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 on user Apr 12 09:39:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Creating event network-vif-deleted:8c15ba29-fa31-4056-a248-840557a7a18a for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 on user Apr 12 09:39:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030724 Apr 12 09:39:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 324/980] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:39:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] HTTP exception thrown: Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 could not be found. Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Request method failure captured: Apr 12 09:40:17 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982 HTTP/1.1 Apr 12 09:40:17 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:40:17 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:40:17 user devstack@n-api.service[61854]: Connection: close Apr 12 09:40:17 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:40:17 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:40:17 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:40:17 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:40:17 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnvHyA9lGxO_ib1n1QMBOMu73Pjyy9L1YAz23_hjnTWQI977DKc7syR9dBFug7sUJFRkhKRiCgQnccMZhT3X9kXGLgLHhDPZxXmfTxRMrMX7vJltI6kPgAg7k54tVk0nLiCQFq3tiKzvIrupVJOUUsrIyqxvYTgL-Z1B16hiwhmvPjA Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Project-Id: 5b7b1c70322c4f31a30e0294291aa165 Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1644949007 Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b7b1c70322c4f31a30e0294291aa165"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b7b1c70322c4f31a30e0294291aa165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b7b1c70322c4f31a30e0294291aa165"}]}] Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesSnapshotTestJSON-1644949007 Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Tenant-Id: 5b7b1c70322c4f31a30e0294291aa165 Apr 12 09:40:17 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1644949007 Apr 12 09:40:17 user devstack@n-api.service[61854]: X-User: tempest-VolumesSnapshotTestJSON-1644949007-project-member Apr 12 09:40:17 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:40:17 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:40:17 user devstack@n-api.service[61854]: X-User-Id: 7b2402ddb2264bc19341580cc719c706 Apr 12 09:40:17 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesSnapshotTestJSON-1644949007-project-member Apr 12 09:40:17 user devstack@n-api.service[61854]: method: > Apr 12 09:40:17 user devstack@n-api.service[61854]: exception: Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 could not be found. Apr 12 09:40:17 user devstack@n-api.service[61854]: action_args: {'id': 'd4bf54e3-c4cd-4f1e-a0c3-eec827238982'} Apr 12 09:40:17 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 could not be found. Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 could not be found. Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 could not be found. Apr 12 09:40:17 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:40:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Returning 404 to user: Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:40:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c584b7da-47c5-4dee-953b-6775ee86da20 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982" status: 404 len: 111 microversion: 2.1 time: 0.038026 Apr 12 09:40:17 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 329/981] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:40:17 2023] GET /compute/v2.1/servers/d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1287954701", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "networks": [{"uuid": "48a4a967-0639-4505-a467-85bc73b75a4c"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] validate_networks() for [('48a4a967-0639-4505-a467-85bc73b75a4c', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting quotas for project 5b7b1c70322c4f31a30e0294291aa165. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting quotas for user 7b2402ddb2264bc19341580cc719c706 and project 5b7b1c70322c4f31a30e0294291aa165. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:40:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:40:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.556875 Apr 12 09:40:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 329/982] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:40:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:40:26 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-25dcaf5f-67d2-48c4-b0d6-96c3c2f713a3 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:40:26 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-25dcaf5f-67d2-48c4-b0d6-96c3c2f713a3 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:40:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:26 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=8 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:27 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-25dcaf5f-67d2-48c4-b0d6-96c3c2f713a3 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:40:27 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-25dcaf5f-67d2-48c4-b0d6-96c3c2f713a3 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b" status: 200 len: 1213 microversion: 2.1 time: 0.140457 Apr 12 09:40:27 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 325/983] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:40:26 2023] GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:27 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:40:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b4b2f725-d53f-4f93-b698-a510116f93c2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 200 len: 1442 microversion: 2.1 time: 0.289574 Apr 12 09:40:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 330/984] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:40:27 2023] GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 1442 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:40:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42b12e5-5e85-4206-866f-42294318f0b0", "tag": "725c2a1c-abed-48f3-8fe7-f724a7552bca"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Creating event network-changed:725c2a1c-abed-48f3-8fe7-f724a7552bca for instance a42b12e5-5e85-4206-866f-42294318f0b0 on user Apr 12 09:40:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036901 Apr 12 09:40:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 330/985] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:40:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:40:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d563bdb7-9e57-43f3-8e33-a957e9aeda4b", "tag": "54dab028-fc6f-489b-80ea-dfe05c140cd2"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Creating event network-changed:54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b on user Apr 12 09:40:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050306 Apr 12 09:40:29 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 326/986] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:40:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:30 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:40:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 204 len: 0 microversion: 2.1 time: 0.121956 Apr 12 09:40:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 331/987] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:40:30 2023] DELETE /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:30 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:40:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e25d9005-ee03-4666-9b76-cca19b2a72ca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 200 len: 1566 microversion: 2.1 time: 0.191364 Apr 12 09:40:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 331/988] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:40:30 2023] GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:40:30 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42b12e5-5e85-4206-866f-42294318f0b0", "name": "network-vif-unplugged", "status": "completed", "tag": "725c2a1c-abed-48f3-8fe7-f724a7552bca"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:30 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Creating event network-vif-unplugged:725c2a1c-abed-48f3-8fe7-f724a7552bca for instance a42b12e5-5e85-4206-866f-42294318f0b0 on user Apr 12 09:40:30 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033968 Apr 12 09:40:30 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 327/989] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:40:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:40:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d563bdb7-9e57-43f3-8e33-a957e9aeda4b", "name": "network-vif-plugged", "status": "completed", "tag": "54dab028-fc6f-489b-80ea-dfe05c140cd2"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Creating event network-vif-plugged:54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b on user Apr 12 09:40:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057484 Apr 12 09:40:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 332/990] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:40:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:40:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ff0aaaf0-5cb7-4867-ae65-90721223d352 req-eaa6a662-9cbf-4f40-8f90-91ca8b355dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42b12e5-5e85-4206-866f-42294318f0b0", "name": "network-vif-deleted", "tag": "725c2a1c-abed-48f3-8fe7-f724a7552bca"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ff0aaaf0-5cb7-4867-ae65-90721223d352 req-eaa6a662-9cbf-4f40-8f90-91ca8b355dc7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ff0aaaf0-5cb7-4867-ae65-90721223d352 req-eaa6a662-9cbf-4f40-8f90-91ca8b355dc7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ff0aaaf0-5cb7-4867-ae65-90721223d352 req-eaa6a662-9cbf-4f40-8f90-91ca8b355dc7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ff0aaaf0-5cb7-4867-ae65-90721223d352 req-eaa6a662-9cbf-4f40-8f90-91ca8b355dc7 service nova] Creating event network-vif-deleted:725c2a1c-abed-48f3-8fe7-f724a7552bca for instance a42b12e5-5e85-4206-866f-42294318f0b0 on user Apr 12 09:40:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ff0aaaf0-5cb7-4867-ae65-90721223d352 req-eaa6a662-9cbf-4f40-8f90-91ca8b355dc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Apr 12 09:40:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 332/991] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:40:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42b12e5-5e85-4206-866f-42294318f0b0", "name": "network-vif-plugged", "status": "completed", "tag": "725c2a1c-abed-48f3-8fe7-f724a7552bca"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Creating event network-vif-plugged:725c2a1c-abed-48f3-8fe7-f724a7552bca for instance a42b12e5-5e85-4206-866f-42294318f0b0 on user Apr 12 09:40:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034414 Apr 12 09:40:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 328/992] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:40:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d563bdb7-9e57-43f3-8e33-a957e9aeda4b", "name": "network-vif-plugged", "status": "completed", "tag": "54dab028-fc6f-489b-80ea-dfe05c140cd2"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:40:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:40:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:40:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:40:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Creating event network-vif-plugged:54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b on user Apr 12 09:40:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074499 Apr 12 09:40:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 333/993] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:40:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:17 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:41:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f74cb5f0-7cef-44cb-ada8-dcffe7200ee2 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b" status: 200 len: 1496 microversion: 2.1 time: 0.400501 Apr 12 09:41:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 333/994] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:41:17 2023] GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b => generated 1496 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:41:20 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 HTTP/1.1 Apr 12 09:41:20 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:41:20 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:41:20 user devstack@n-api.service[61855]: Connection: close Apr 12 09:41:20 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:41:20 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:41:20 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:41:20 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:41:20 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:41:20 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:41:20 user devstack@n-api.service[61855]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:41:20 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:41:20 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:41:20 user devstack@n-api.service[61855]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:41:20 user devstack@n-api.service[61855]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:41:20 user devstack@n-api.service[61855]: method: > Apr 12 09:41:20 user devstack@n-api.service[61855]: exception: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:41:20 user devstack@n-api.service[61855]: action_args: {'id': 'a42b12e5-5e85-4206-866f-42294318f0b0'} Apr 12 09:41:20 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:41:20 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:41:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:41:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4820f5f4-8117-49ca-ac7d-18b8e983d4b2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 404 len: 111 microversion: 2.1 time: 0.051841 Apr 12 09:41:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 329/995] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:41:20 2023] GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:41:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-273431965", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-390353875", "security_groups": [{"name": "tempest-secgroup-smoke-837914729"}], "block_device_mapping_v2": [{"uuid": "d1ab1273-9a1f-422c-8d8c-85ec688d5b9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04d87eab-eb0c-4ca0-b654-941b5fb8be90"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:41:20 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] validate_networks() for [('04d87eab-eb0c-4ca0-b654-941b5fb8be90', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for user 4d3fba65a6ff4e73addd3ec6cdbb08cf and project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:41:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1ab1273-9a1f-422c-8d8c-85ec688d5b9a',volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:41:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.804217 Apr 12 09:41:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 334/996] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:41:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:41:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-23a76f1c-f32e-4b2e-a7b2-0ceb57d021be tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:41:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-23a76f1c-f32e-4b2e-a7b2-0ceb57d021be tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:41:21 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-23a76f1c-f32e-4b2e-a7b2-0ceb57d021be tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:41:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-23a76f1c-f32e-4b2e-a7b2-0ceb57d021be tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" status: 200 len: 1088 microversion: 2.1 time: 0.073098 Apr 12 09:41:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 334/997] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:41:21 2023] GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:41:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:41:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Creating event network-changed:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:41:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089021 Apr 12 09:41:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 330/998] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:41:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:41:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "name": "network-vif-plugged", "status": "completed", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:41:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Creating event network-vif-plugged:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:41:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083388 Apr 12 09:41:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 335/999] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:41:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:41:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "name": "network-vif-plugged", "status": "completed", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:41:32 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:32 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:32 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:41:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Creating event network-vif-plugged:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:41:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048443 Apr 12 09:41:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 335/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:41:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:11 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:42:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-7d23ecbf-80da-4c7e-b46b-fd82d33a3c0a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" status: 200 len: 1440 microversion: 2.1 time: 0.194801 Apr 12 09:42:11 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 331/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:42:11 2023] GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => generated 1440 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e650ef38-fa8c-4be8-a0bc-e34015660b22", "device": "/dev/vdb"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340669 Apr 12 09:42:17 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 336/1002] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:42:17 2023] POST /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:35 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'services' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:42:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/os-volume_attachments/e650ef38-fa8c-4be8-a0bc-e34015660b22" status: 202 len: 0 microversion: 2.1 time: 0.188110 Apr 12 09:42:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 336/1003] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:42:35 2023] DELETE /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/os-volume_attachments/e650ef38-fa8c-4be8-a0bc-e34015660b22 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:42:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b" status: 204 len: 0 microversion: 2.1 time: 0.128103 Apr 12 09:42:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 332/1004] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:42:35 2023] DELETE /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:36 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:42:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b4d4055c-0782-41c4-aa80-93941809e8b5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b" status: 200 len: 1548 microversion: 2.1 time: 0.278490 Apr 12 09:42:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 337/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:42:35 2023] GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b => generated 1548 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:42:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d563bdb7-9e57-43f3-8e33-a957e9aeda4b", "name": "network-vif-unplugged", "status": "completed", "tag": "54dab028-fc6f-489b-80ea-dfe05c140cd2"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:42:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Creating event network-vif-unplugged:54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b on user Apr 12 09:42:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031124 Apr 12 09:42:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 337/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:42:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:42:39 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d563bdb7-9e57-43f3-8e33-a957e9aeda4b", "name": "network-vif-deleted", "tag": "54dab028-fc6f-489b-80ea-dfe05c140cd2"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:42:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:39 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] Creating event network-vif-deleted:54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b on user Apr 12 09:42:39 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 Apr 12 09:42:39 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 333/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:42:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:42:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d563bdb7-9e57-43f3-8e33-a957e9aeda4b", "name": "network-vif-plugged", "status": "completed", "tag": "54dab028-fc6f-489b-80ea-dfe05c140cd2"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:42:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Creating event network-vif-plugged:54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b on user Apr 12 09:42:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028070 Apr 12 09:42:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 338/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:42:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:12 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:43:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ec62513c-41d5-486b-b8fa-c7b4d80d518a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" status: 200 len: 1440 microversion: 2.1 time: 0.161782 Apr 12 09:43:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 338/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:43:11 2023] GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => generated 1440 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:43:13 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:43:13 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:43:13 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:43:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:13 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Creating event network-changed:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:43:13 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036810 Apr 12 09:43:13 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 334/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:43:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1913845244", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-390353875", "security_groups": [{"name": "tempest-secgroup-smoke-837914729"}], "block_device_mapping_v2": [{"uuid": "1063b66e-b23f-4a63-83e2-631935335e70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04d87eab-eb0c-4ca0-b654-941b5fb8be90"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] validate_networks() for [('04d87eab-eb0c-4ca0-b654-941b5fb8be90', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:43:18 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting quotas for user 4d3fba65a6ff4e73addd3ec6cdbb08cf and project 1a0437bfee4545949707443636e07b80. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:43:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:43:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1063b66e-b23f-4a63-83e2-631935335e70',volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:43:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.772409 Apr 12 09:43:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 339/1011] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:43:18 2023] POST /compute/v2.1/servers => generated 403 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:43:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-72475edb-edc9-4f4a-825d-03c45dee4da2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:43:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-72475edb-edc9-4f4a-825d-03c45dee4da2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:43:19 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-72475edb-edc9-4f4a-825d-03c45dee4da2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:43:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-72475edb-edc9-4f4a-825d-03c45dee4da2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9" status: 200 len: 1089 microversion: 2.1 time: 0.062760 Apr 12 09:43:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 339/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:43:19 2023] GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:43:21 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:43:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:21 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Creating event network-changed:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:43:21 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033781 Apr 12 09:43:21 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 335/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:43:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] HTTP exception thrown: Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b could not be found. Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Request method failure captured: Apr 12 09:43:26 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b HTTP/1.1 Apr 12 09:43:26 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:43:26 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:43:26 user devstack@n-api.service[61854]: Connection: close Apr 12 09:43:26 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:43:26 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:43:26 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:43:26 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:43:26 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnvHyA9lGxO_ib1n1QMBOMu73Pjyy9L1YAz23_hjnTWQI977DKc7syR9dBFug7sUJFRkhKRiCgQnccMZhT3X9kXGLgLHhDPZxXmfTxRMrMX7vJltI6kPgAg7k54tVk0nLiCQFq3tiKzvIrupVJOUUsrIyqxvYTgL-Z1B16hiwhmvPjA Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Project-Id: 5b7b1c70322c4f31a30e0294291aa165 Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1644949007 Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b7b1c70322c4f31a30e0294291aa165"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b7b1c70322c4f31a30e0294291aa165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b7b1c70322c4f31a30e0294291aa165"}]}] Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesSnapshotTestJSON-1644949007 Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Tenant-Id: 5b7b1c70322c4f31a30e0294291aa165 Apr 12 09:43:26 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1644949007 Apr 12 09:43:26 user devstack@n-api.service[61854]: X-User: tempest-VolumesSnapshotTestJSON-1644949007-project-member Apr 12 09:43:26 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:43:26 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:43:26 user devstack@n-api.service[61854]: X-User-Id: 7b2402ddb2264bc19341580cc719c706 Apr 12 09:43:26 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesSnapshotTestJSON-1644949007-project-member Apr 12 09:43:26 user devstack@n-api.service[61854]: method: > Apr 12 09:43:26 user devstack@n-api.service[61854]: exception: Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b could not be found. Apr 12 09:43:26 user devstack@n-api.service[61854]: action_args: {'id': 'd563bdb7-9e57-43f3-8e33-a957e9aeda4b'} Apr 12 09:43:26 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b could not be found. Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b could not be found. Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b could not be found. Apr 12 09:43:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:43:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Returning 404 to user: Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:43:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-957a0aad-e0f1-4158-800e-ec6725e1b9b7 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b" status: 404 len: 111 microversion: 2.1 time: 0.040656 Apr 12 09:43:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 340/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:43:26 2023] GET /compute/v2.1/servers/d563bdb7-9e57-43f3-8e33-a957e9aeda4b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:43:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "name": "network-vif-plugged", "status": "completed", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:43:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:43:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Creating event network-vif-plugged:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:43:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031788 Apr 12 09:43:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 340/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:43:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:43:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "name": "network-vif-plugged", "status": "completed", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:43:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:43:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:43:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:43:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Creating event network-vif-plugged:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:43:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Apr 12 09:43:29 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 336/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:43:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:44:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:44:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f3d6a29e-0a84-48f0-9b4d-7fbd7ed467d9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9" status: 200 len: 1442 microversion: 2.1 time: 0.158689 Apr 12 09:44:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 341/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:44:09 2023] GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:44:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d4eeb385-9dd0-453e-bd7d-aab5101c1b41 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b9a6ef0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-677654037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFOqIN1Pf1NB/QjxUMaNgH6RoPt5npz9d2f3DihQHSx4VSWqvA79iJxXvGaIRpuSkyfaxajHPH7p7S1YgzHrmkTia3ryFD9Hgdem+xd8sFXeghoii97Du2AgQJb6GqD2w=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:44:11 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-d4eeb385-9dd0-453e-bd7d-aab5101c1b41 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for project 044d0193867a407ba80522df35f5d667. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:44:11 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-d4eeb385-9dd0-453e-bd7d-aab5101c1b41 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for user 345fff9dd4ce4b74bc87ff29db51e162 and project 044d0193867a407ba80522df35f5d667. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:44:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d4eeb385-9dd0-453e-bd7d-aab5101c1b41 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058840 Apr 12 09:44:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 341/1018] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:44:11 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:44:11 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:11 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:11 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1404599988", "imageRef": "bf78848c-38c3-43e7-b908-42b091dbbdbd", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-677654037", "networks": [{"uuid": "5d729f24-1410-49e7-9480-31a13a426d8e"}]}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:44:11 user devstack@n-api.service[61855]: DEBUG nova.network.neutron [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] validate_networks() for [('5d729f24-1410-49e7-9480-31a13a426d8e', None, None, None, None, None)] {{(pid=61855) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image limits 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image pref 0:0:0 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for project 044d0193867a407ba80522df35f5d667. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for user 345fff9dd4ce4b74bc87ff29db51e162 and project 044d0193867a407ba80522df35f5d667. Resources: {'cores', 'instances', 'ram'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Going to run 1 instances... {{(pid=61855) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:44:12 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf78848c-38c3-43e7-b908-42b091dbbdbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:44:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.603743 Apr 12 09:44:12 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 337/1019] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:44:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:44:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9bd0d490-ba13-49aa-b9d3-540fcbdaeeea tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:44:12 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9bd0d490-ba13-49aa-b9d3-540fcbdaeeea tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:44:12 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9bd0d490-ba13-49aa-b9d3-540fcbdaeeea tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:44:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9bd0d490-ba13-49aa-b9d3-540fcbdaeeea tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1252 microversion: 2.1 time: 0.064732 Apr 12 09:44:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 342/1020] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:44:12 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1252 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:44:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:44:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Creating event network-changed:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:44:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041528 Apr 12 09:44:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 342/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:44:17 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-plugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:44:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:44:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:44:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:44:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Creating event network-vif-plugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:44:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217835 Apr 12 09:44:17 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 338/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:44:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-plugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:44:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:44:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:44:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:44:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:44:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Creating event network-vif-plugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:44:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032148 Apr 12 09:44:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 343/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:44:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:02 user devstack@n-api.service[61853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 09:45:02 user devstack@n-api.service[61853]: Wed Apr 12 09:45:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 (ip 10.0.0.210) !!! Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:02 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:45:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-42a68c69-e96e-4d92-ada2-236a39f7fcb4 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1537 microversion: 2.1 time: 0.191254 Apr 12 09:45:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 343/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:45:02 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1537 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:09 user devstack@n-api.service[61855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 09:45:09 user devstack@n-api.service[61855]: Wed Apr 12 09:45:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 (ip 10.0.0.210) !!! Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:09 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:45:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-175a95e2-fd21-4a74-8cf6-b0cbef0ee0f9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9" status: 200 len: 1442 microversion: 2.1 time: 0.175683 Apr 12 09:45:09 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 339/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:45:09 2023] GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:45:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:45:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Creating event network-changed:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:45:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042144 Apr 12 09:45:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 344/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:45:12 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:45:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:12 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Creating event network-changed:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:45:12 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029405 Apr 12 09:45:12 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 340/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:45:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:45:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9" status: 204 len: 0 microversion: 2.1 time: 0.118788 Apr 12 09:45:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 344/1028] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:45:12 2023] DELETE /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:45:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-90e5d10b-1820-4533-985e-86381e51bf41 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9" status: 200 len: 1567 microversion: 2.1 time: 0.250671 Apr 12 09:45:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 345/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:45:12 2023] GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:45:13 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "name": "network-vif-unplugged", "status": "completed", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:45:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:13 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Creating event network-vif-unplugged:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:45:13 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033735 Apr 12 09:45:13 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 341/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:45:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "name": "network-vif-deleted", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:45:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] Creating event network-vif-deleted:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:45:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Apr 12 09:45:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 345/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:45:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d302843-fdb1-4b87-865d-17c7627c86a9", "name": "network-vif-plugged", "status": "completed", "tag": "007e55cd-ac21-45a1-8067-7c1d254589ca"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:45:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:45:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:45:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:45:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Creating event network-vif-plugged:007e55cd-ac21-45a1-8067-7c1d254589ca for instance 9d302843-fdb1-4b87-865d-17c7627c86a9 on user Apr 12 09:45:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037804 Apr 12 09:45:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 346/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=10 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:02 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:46:03 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-dbe947f9-3664-4cdf-9cd5-ee04b501ee42 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1537 microversion: 2.1 time: 0.229839 Apr 12 09:46:03 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 342/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:02 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Searching by: {'deleted': False, 'project_id': '044d0193867a407ba80522df35f5d667'} {{(pid=61853) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 could not be found. Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:46:03 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 HTTP/1.1 Apr 12 09:46:03 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:46:03 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:46:03 user devstack@n-api.service[61854]: Connection: close Apr 12 09:46:03 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:46:03 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:46:03 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:46:03 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:46:03 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:03 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:03 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:03 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:46:03 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:46:03 user devstack@n-api.service[61854]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:46:03 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:03 user devstack@n-api.service[61854]: method: > Apr 12 09:46:03 user devstack@n-api.service[61854]: exception: Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 could not be found. Apr 12 09:46:03 user devstack@n-api.service[61854]: action_args: {'id': '9d302843-fdb1-4b87-865d-17c7627c86a9'} Apr 12 09:46:03 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 could not be found. Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 could not be found. Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 could not be found. Apr 12 09:46:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:46:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7ee5fc9e-21a9-481f-91c4-250b54684af0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9" status: 404 len: 111 microversion: 2.1 time: 0.145892 Apr 12 09:46:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 347/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:03 2023] GET /compute/v2.1/servers/9d302843-fdb1-4b87-865d-17c7627c86a9 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:46:03 user devstack@n-api.service[61853]: DEBUG nova.compute.multi_cell_list [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61853) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 09:46:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b7e0d0f6-350c-4ce8-8331-f9e516dcf9d8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.408004 Apr 12 09:46:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 346/1035] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 09:46:03 2023] GET /compute/v2.1/servers => generated 341 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:03 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:46:03 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-c2c56cce-a538-4571-bfd0-15714c660b7c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1537 microversion: 2.1 time: 0.150199 Apr 12 09:46:03 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 343/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:03 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448867 Apr 12 09:46:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 348/1037] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:46:06 2023] POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Creating event network-changed:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:46:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028766 Apr 12 09:46:08 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 344/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:46:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" status: 204 len: 0 microversion: 2.1 time: 0.112855 Apr 12 09:46:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 347/1039] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:46:08 2023] DELETE /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:46:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bca0112c-2e53-48da-b042-a284cd0edfd2 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" status: 200 len: 1565 microversion: 2.1 time: 0.244551 Apr 12 09:46:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 349/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:08 2023] GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => generated 1565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "name": "network-vif-unplugged", "status": "completed", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:08 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Creating event network-vif-unplugged:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:46:08 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043189 Apr 12 09:46:08 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 345/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-675c7b8a-408e-45e0-be36-5a9aaaf230e6 req-33959885-7ba8-45ed-ba78-8108d2bde56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "name": "network-vif-deleted", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-675c7b8a-408e-45e0-be36-5a9aaaf230e6 req-33959885-7ba8-45ed-ba78-8108d2bde56c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-675c7b8a-408e-45e0-be36-5a9aaaf230e6 req-33959885-7ba8-45ed-ba78-8108d2bde56c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-675c7b8a-408e-45e0-be36-5a9aaaf230e6 req-33959885-7ba8-45ed-ba78-8108d2bde56c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-675c7b8a-408e-45e0-be36-5a9aaaf230e6 req-33959885-7ba8-45ed-ba78-8108d2bde56c service nova] Creating event network-vif-deleted:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:46:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-675c7b8a-408e-45e0-be36-5a9aaaf230e6 req-33959885-7ba8-45ed-ba78-8108d2bde56c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034845 Apr 12 09:46:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 348/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae", "name": "network-vif-plugged", "status": "completed", "tag": "183ee788-84e9-448a-a5d8-6c6d95b9d250"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Creating event network-vif-plugged:183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae on user Apr 12 09:46:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038996 Apr 12 09:46:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 350/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:16 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:46:16 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-5f55c884-715c-43e1-9b6d-760e2af2e912 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1583 microversion: 2.1 time: 0.179615 Apr 12 09:46:16 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 346/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:16 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1583 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:46:18 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Creating event network-changed:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:46:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033274 Apr 12 09:46:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 349/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-975665009"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:19 user devstack@n-api.service[61854]: INFO nova.network.security_group_api [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Adding security group 97928032-80d5-45fd-a41d-332389440592 to port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d Apr 12 09:46:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-aac092ca-74a4-4219-8e8a-5c3fcc8e985e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/action" status: 202 len: 0 microversion: 2.1 time: 0.554413 Apr 12 09:46:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 351/1046] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:46:19 2023] POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:20 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:20 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Creating event network-changed:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:46:20 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051998 Apr 12 09:46:20 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 347/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:20 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:46:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f9390efa-bbed-478f-8524-c013c4273bb7 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1747 microversion: 2.1 time: 0.213831 Apr 12 09:46:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 350/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:20 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1747 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/action" status: 202 len: 0 microversion: 2.1 time: 0.085974 Apr 12 09:46:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 352/1049] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:46:22 2023] POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:22 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:23 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:46:23 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-790c6b31-72af-48cd-941c-a2772e306820 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1749 microversion: 2.1 time: 0.172066 Apr 12 09:46:23 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 348/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:22 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:46:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-unplugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Creating event network-vif-unplugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:46:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032837 Apr 12 09:46:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 351/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-plugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Creating event network-vif-plugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:46:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037734 Apr 12 09:46:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 353/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:28 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-plugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Creating event network-vif-plugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:46:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052240 Apr 12 09:46:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 349/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:46:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-plugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:46:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Creating event network-vif-plugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:46:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030954 Apr 12 09:46:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 352/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:46:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae could not be found. Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:46:58 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae HTTP/1.1 Apr 12 09:46:58 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:46:58 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:46:58 user devstack@n-api.service[61854]: Connection: close Apr 12 09:46:58 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:46:58 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:46:58 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:46:58 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:46:58 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:58 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:58 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:58 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:46:58 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:46:58 user devstack@n-api.service[61854]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:46:58 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:58 user devstack@n-api.service[61854]: method: > Apr 12 09:46:58 user devstack@n-api.service[61854]: exception: Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae could not be found. Apr 12 09:46:58 user devstack@n-api.service[61854]: action_args: {'id': 'a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae'} Apr 12 09:46:58 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae could not be found. Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae could not be found. Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae could not be found. Apr 12 09:46:58 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:46:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:46:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-22e8bb90-d3b6-49a3-b2df-f06755e3c8e3 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" status: 404 len: 111 microversion: 2.1 time: 0.035694 Apr 12 09:46:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 354/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:58 2023] GET /compute/v2.1/servers/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=16 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=32 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:46:59 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 HTTP/1.1 Apr 12 09:46:59 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:46:59 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:46:59 user devstack@n-api.service[61855]: Connection: close Apr 12 09:46:59 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:46:59 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:46:59 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:46:59 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:46:59 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:59 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:59 user devstack@n-api.service[61855]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:59 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:46:59 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:46:59 user devstack@n-api.service[61855]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:46:59 user devstack@n-api.service[61855]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:59 user devstack@n-api.service[61855]: method: > Apr 12 09:46:59 user devstack@n-api.service[61855]: exception: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61855]: action_args: {'id': 'a42b12e5-5e85-4206-866f-42294318f0b0'} Apr 12 09:46:59 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:46:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f1bed62d-ca2e-4b27-b3b0-8398265c7e70 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 404 len: 111 microversion: 2.1 time: 0.042734 Apr 12 09:46:59 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 350/1056] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:46:59 2023] DELETE /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:46:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HTTP exception thrown: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Request method failure captured: Apr 12 09:46:59 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 HTTP/1.1 Apr 12 09:46:59 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:46:59 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:46:59 user devstack@n-api.service[61853]: Connection: close Apr 12 09:46:59 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:46:59 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:46:59 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:46:59 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:46:59 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNnoYZcMRzUTP0k67kMJvUz2If9E043siWnrt3YQ42j6iSHpYX7gg18Kv2CdtnISjZpQqgbrsY6LWcP9ASgvgw-8pAE7IIspdvJ88ZJg7D3kk_uCk312sVK6xuu1xwFz2PnzLpYT8TOXjeA3A9_cKBdcJ3TUebAR8mgnDHVqNr_7fF3w Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Project-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0437bfee4545949707443636e07b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0437bfee4545949707443636e07b80"}]}] Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Tenant: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Tenant-Id: 1a0437bfee4545949707443636e07b80 Apr 12 09:46:59 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestVolumeBootPattern-757175647 Apr 12 09:46:59 user devstack@n-api.service[61853]: X-User: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:59 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:46:59 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:46:59 user devstack@n-api.service[61853]: X-User-Id: 4d3fba65a6ff4e73addd3ec6cdbb08cf Apr 12 09:46:59 user devstack@n-api.service[61853]: X-User-Name: tempest-TestVolumeBootPattern-757175647-project-member Apr 12 09:46:59 user devstack@n-api.service[61853]: method: > Apr 12 09:46:59 user devstack@n-api.service[61853]: exception: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61853]: action_args: {'id': 'a42b12e5-5e85-4206-866f-42294318f0b0'} Apr 12 09:46:59 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. Apr 12 09:46:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:46:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Returning 404 to user: Instance a42b12e5-5e85-4206-866f-42294318f0b0 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:46:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9c4aad73-3b10-4d14-b155-4187d41e581a tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0" status: 404 len: 111 microversion: 2.1 time: 0.036775 Apr 12 09:46:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 353/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:46:59 2023] GET /compute/v2.1/servers/a42b12e5-5e85-4206-866f-42294318f0b0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:47:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1f254e76-c33d-40ce-9d28-9381a3e9df9e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Calling method '.version_select at 0x7fbd5b800af0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:47:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1f254e76-c33d-40ce-9d28-9381a3e9df9e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-390353875" status: 202 len: 0 microversion: 2.1 time: 0.025084 Apr 12 09:47:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 355/1058] 10.0.0.210 () {62 vars in 1337 bytes} [Wed Apr 12 09:47:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-390353875 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:47:13 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:47:13 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-dd733129-1a4e-40f3-8cc4-daea6609b34e tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1747 microversion: 2.1 time: 0.172472 Apr 12 09:47:13 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 351/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:47:13 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1747 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:47:23 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:23 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7e99ea02-9cec-4950-8b4b-a5733c2aa7f5 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Action: 'create', calling method: .version_select at 0x7fbd5b896b90>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-2042005072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjsDJkKscm/m1JO7QZ595+SiXDjpmpWhJ71MxZtaXRHacQPfxCqvNSfAjwlmPltSXx3TKyV4ATsW49g2lUlMNeiZh5xK2SmbT+BEk5RTvMv1raH8TwLLiSnYkURTu3Iaw=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:47:23 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-7e99ea02-9cec-4950-8b4b-a5733c2aa7f5 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting quotas for project 71345b53304d4b99b233f65d427343ba. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:47:23 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-7e99ea02-9cec-4950-8b4b-a5733c2aa7f5 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting quotas for user 21416f43494540f2ad0c2e36edd3dc6f and project 71345b53304d4b99b233f65d427343ba. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:47:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7e99ea02-9cec-4950-8b4b-a5733c2aa7f5 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.268481 Apr 12 09:47:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 354/1060] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:47:23 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:47:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-374987338", "imageRef": "4a835d20-3733-4a8b-bebd-54dfa6135dd6", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-2042005072", "security_groups": [{"name": "tempest-secgroup-smoke-1907532600"}], "networks": [{"uuid": "610b0245-1993-4002-acd5-0cd5ae10b1a1"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:47:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:24 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] validate_networks() for [('610b0245-1993-4002-acd5-0cd5ae10b1a1', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting quotas for project 71345b53304d4b99b233f65d427343ba. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting quotas for user 21416f43494540f2ad0c2e36edd3dc6f and project 71345b53304d4b99b233f65d427343ba. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:47:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a835d20-3733-4a8b-bebd-54dfa6135dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:47:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.828909 Apr 12 09:47:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 356/1061] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:47:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:47:25 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-ae333de3-2226-45fd-8344-a7c9ee6df98d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:47:25 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-ae333de3-2226-45fd-8344-a7c9ee6df98d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:47:25 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:25 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:47:25 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-ae333de3-2226-45fd-8344-a7c9ee6df98d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21416f43494540f2ad0c2e36edd3dc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71345b53304d4b99b233f65d427343ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:47:25 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-ae333de3-2226-45fd-8344-a7c9ee6df98d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" status: 200 len: 1256 microversion: 2.1 time: 0.094568 Apr 12 09:47:25 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 352/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:47:25 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => generated 1256 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:47:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "tag": "0db4838f-8419-4187-a457-94bb66310863"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:47:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:47:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:47:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:47:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Creating event network-changed:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:47:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079183 Apr 12 09:47:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 355/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:47:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:47:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "name": "network-vif-plugged", "status": "completed", "tag": "0db4838f-8419-4187-a457-94bb66310863"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:47:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:47:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:47:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:47:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Creating event network-vif-plugged:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:47:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034554 Apr 12 09:47:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 357/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:47:32 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "name": "network-vif-plugged", "status": "completed", "tag": "0db4838f-8419-4187-a457-94bb66310863"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:47:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:47:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:47:32 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:47:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Creating event network-vif-plugged:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:47:32 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031823 Apr 12 09:47:32 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 353/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-975665009"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:13 user devstack@n-api.service[61853]: INFO nova.network.security_group_api [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Removing security group 97928032-80d5-45fd-a41d-332389440592 from port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d Apr 12 09:48:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-44a5504b-8ba7-4987-b976-7ac94a5ecf72 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/action" status: 202 len: 0 microversion: 2.1 time: 0.566956 Apr 12 09:48:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 356/1066] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:48:13 2023] POST /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Creating event network-changed:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:48:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093450 Apr 12 09:48:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 358/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:48:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Creating event network-changed:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:48:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041190 Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:48:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 354/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:48:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:15 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'services' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:48:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments/e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" status: 202 len: 0 microversion: 2.1 time: 0.176723 Apr 12 09:48:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 357/1069] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:48:15 2023] DELETE /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments/e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-25daf40d-be90-411a-9509-ea0a2250c858 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048574 Apr 12 09:48:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 359/1070] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:48:15 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:48:15 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21416f43494540f2ad0c2e36edd3dc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71345b53304d4b99b233f65d427343ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:48:15 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4d785c5c-f45b-48ed-9940-4e66b64a47e8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" status: 200 len: 1568 microversion: 2.1 time: 0.176935 Apr 12 09:48:15 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 355/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:48:15 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2cfecc54-5eae-4750-ad56-0572ec2eaa66 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047098 Apr 12 09:49:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 358/1072] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:49:05 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] HTTP exception thrown: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 is not attached to volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Request method failure captured: Apr 12 09:49:05 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments/e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 HTTP/1.1 Apr 12 09:49:05 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:49:05 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:49:05 user devstack@n-api.service[61854]: Connection: close Apr 12 09:49:05 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:49:05 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:49:05 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:49:05 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:49:05 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNn1jPO4A7Fe8Gq1S6HaPfuby4JhKEG2dEDVmzE-SIpt3dLriocjOHPADLB6NyY7UMw9zP6YMCdk1rxN9pfJ0dgpdOLjFcBfvWslHF6Xbp-jxv9RU-AjBrRykROPaGJeJBXxcJRWM8Tr_xZmX1yaphcGwzDTEGZur17HEDj81_TL3E6s Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Project-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/044d0193867a407ba80522df35f5d667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}] Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Tenant: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Tenant-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:49:05 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:49:05 user devstack@n-api.service[61854]: X-User: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:49:05 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:49:05 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:49:05 user devstack@n-api.service[61854]: X-User-Id: 345fff9dd4ce4b74bc87ff29db51e162 Apr 12 09:49:05 user devstack@n-api.service[61854]: X-User-Name: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:49:05 user devstack@n-api.service[61854]: method: > Apr 12 09:49:05 user devstack@n-api.service[61854]: exception: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 is not attached to volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 Apr 12 09:49:05 user devstack@n-api.service[61854]: action_args: {'server_id': 'b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67', 'id': 'e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4'} Apr 12 09:49:05 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4. Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 is not attached to volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 is not attached to volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 Apr 12 09:49:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:49:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Returning 404 to user: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 is not attached to volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:49:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d4e66133-ad4f-48d3-affe-93152883942c tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments/e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" status: 404 len: 154 microversion: 2.1 time: 0.101082 Apr 12 09:49:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 360/1073] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:49:05 2023] DELETE /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/os-volume_attachments/e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=8 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:07 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:49:07 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 204 len: 0 microversion: 2.1 time: 0.160023 Apr 12 09:49:07 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 356/1074] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:49:07 2023] DELETE /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:08 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:49:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-772f17b4-ce45-4cff-9ee1-8a44674fb5e0 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 200 len: 1543 microversion: 2.1 time: 0.177188 Apr 12 09:49:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 359/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:49:07 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 1543 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:49:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-unplugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:49:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Creating event network-vif-unplugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:49:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036204 Apr 12 09:49:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 361/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:49:09 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-4bc66a06-c71c-4fe2-a0dc-b3e70474d7c2 req-07e2da43-d2fc-4d00-a975-c6305c2ddbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-deleted", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:49:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4bc66a06-c71c-4fe2-a0dc-b3e70474d7c2 req-07e2da43-d2fc-4d00-a975-c6305c2ddbb1 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4bc66a06-c71c-4fe2-a0dc-b3e70474d7c2 req-07e2da43-d2fc-4d00-a975-c6305c2ddbb1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:09 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-4bc66a06-c71c-4fe2-a0dc-b3e70474d7c2 req-07e2da43-d2fc-4d00-a975-c6305c2ddbb1 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-4bc66a06-c71c-4fe2-a0dc-b3e70474d7c2 req-07e2da43-d2fc-4d00-a975-c6305c2ddbb1 service nova] Creating event network-vif-deleted:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:49:09 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-4bc66a06-c71c-4fe2-a0dc-b3e70474d7c2 req-07e2da43-d2fc-4d00-a975-c6305c2ddbb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036310 Apr 12 09:49:09 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 357/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:49:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:49:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67", "name": "network-vif-plugged", "status": "completed", "tag": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:49:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Creating event network-vif-plugged:62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 on user Apr 12 09:49:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030184 Apr 12 09:49:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 360/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:16 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21416f43494540f2ad0c2e36edd3dc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71345b53304d4b99b233f65d427343ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:49:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-885f06d9-c08e-44ba-93a4-77cdf1bb758a tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" status: 200 len: 1568 microversion: 2.1 time: 0.439202 Apr 12 09:49:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 362/1079] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:49:15 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => generated 1568 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:49:19 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "tag": "0db4838f-8419-4187-a457-94bb66310863"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:49:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:19 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Creating event network-changed:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:49:19 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035189 Apr 12 09:49:19 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 358/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:49:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7576e648-fab5-40a5-9a36-8951a764f77c"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275842 Apr 12 09:49:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 361/1081] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:49:19 2023] POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:34 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'services' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:49:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/7576e648-fab5-40a5-9a36-8951a764f77c" status: 202 len: 0 microversion: 2.1 time: 0.168924 Apr 12 09:49:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 363/1082] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:49:34 2023] DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/7576e648-fab5-40a5-9a36-8951a764f77c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-6b6c4c0c-6084-45ec-8773-736dfbb4dc0d tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056320 Apr 12 09:49:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 359/1083] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:49:34 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:49:58 user devstack@n-api.service[61853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 09:49:58 user devstack@n-api.service[61853]: Wed Apr 12 09:49:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 (ip 10.0.0.210) !!! Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:49:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] HTTP exception thrown: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 could not be found. Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Request method failure captured: Apr 12 09:49:58 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 HTTP/1.1 Apr 12 09:49:58 user devstack@n-api.service[61853]: Accept: application/json Apr 12 09:49:58 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 09:49:58 user devstack@n-api.service[61853]: Connection: close Apr 12 09:49:58 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 09:49:58 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 09:49:58 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 09:49:58 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 09:49:58 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNn1jPO4A7Fe8Gq1S6HaPfuby4JhKEG2dEDVmzE-SIpt3dLriocjOHPADLB6NyY7UMw9zP6YMCdk1rxN9pfJ0dgpdOLjFcBfvWslHF6Xbp-jxv9RU-AjBrRykROPaGJeJBXxcJRWM8Tr_xZmX1yaphcGwzDTEGZur17HEDj81_TL3E6s Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Project-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Role: reader,member Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Roles: reader,member Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/044d0193867a407ba80522df35f5d667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}] Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Tenant: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Tenant-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:49:58 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:49:58 user devstack@n-api.service[61853]: X-User: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:49:58 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 09:49:58 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 09:49:58 user devstack@n-api.service[61853]: X-User-Id: 345fff9dd4ce4b74bc87ff29db51e162 Apr 12 09:49:58 user devstack@n-api.service[61853]: X-User-Name: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:49:58 user devstack@n-api.service[61853]: method: > Apr 12 09:49:58 user devstack@n-api.service[61853]: exception: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 could not be found. Apr 12 09:49:58 user devstack@n-api.service[61853]: action_args: {'id': 'b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67'} Apr 12 09:49:58 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 could not be found. Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 could not be found. Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 could not be found. Apr 12 09:49:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 09:49:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Returning 404 to user: Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:49:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0930e2d8-53a5-48d1-9785-8666b731185b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" status: 404 len: 111 microversion: 2.1 time: 0.148448 Apr 12 09:49:58 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 362/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:49:58 2023] GET /compute/v2.1/servers/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 09:49:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:49:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-66c804fa-8d98-4325-8cd6-bd1386bbaa7a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '.version_select at 0x7fbd5b800af0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:49:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-66c804fa-8d98-4325-8cd6-bd1386bbaa7a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-677654037" status: 202 len: 0 microversion: 2.1 time: 0.072247 Apr 12 09:49:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 364/1085] 10.0.0.210 () {62 vars in 1346 bytes} [Wed Apr 12 09:49:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-677654037 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:50:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-2950a359-16a2-4704-ad01-9467de95ffba tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'create', calling method: .version_select at 0x7fbd5bbe2290>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1594156326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnFaeD5GW9hY7Blf+Pjo28Vs1JAT8Z90GiQtJ9zEC7ZRQvTPKDHKGOj7tm4xggd2XKmjB24E2nvfrSxbRu5ogbU+9Fl/0PqUIw50qaxHirma1o6zI0F2bDm2CZnSNpICg=="}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:50:00 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:00 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:00 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-2950a359-16a2-4704-ad01-9467de95ffba tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for project 044d0193867a407ba80522df35f5d667. Resources: {'key_pairs'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:50:00 user devstack@n-api.service[61855]: DEBUG nova.quota [None req-2950a359-16a2-4704-ad01-9467de95ffba tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for user 345fff9dd4ce4b74bc87ff29db51e162 and project 044d0193867a407ba80522df35f5d667. Resources: {'key_pairs'} {{(pid=61855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:50:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-2950a359-16a2-4704-ad01-9467de95ffba tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060291 Apr 12 09:50:00 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 360/1086] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:50:00 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:50:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1994871489", "imageRef": "98a59b0c-b130-489f-b5f6-1f8372109214", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1594156326", "networks": [{"uuid": "5d729f24-1410-49e7-9480-31a13a426d8e"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:50:00 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] validate_networks() for [('5d729f24-1410-49e7-9480-31a13a426d8e', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for project 044d0193867a407ba80522df35f5d667. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting quotas for user 345fff9dd4ce4b74bc87ff29db51e162 and project 044d0193867a407ba80522df35f5d667. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:50:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98a59b0c-b130-489f-b5f6-1f8372109214',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:50:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.736058 Apr 12 09:50:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 363/1087] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:50:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:50:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ea8c7d45-5d98-4abf-8bfd-36c205370152 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:50:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ea8c7d45-5d98-4abf-8bfd-36c205370152 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:50:01 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ea8c7d45-5d98-4abf-8bfd-36c205370152 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:50:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ea8c7d45-5d98-4abf-8bfd-36c205370152 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1253 microversion: 2.1 time: 0.095241 Apr 12 09:50:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 365/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:50:01 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1253 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:50:04 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:50:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Creating event network-changed:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:50:04 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029631 Apr 12 09:50:04 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 361/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:50:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:50:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:50:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:50:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034582 Apr 12 09:50:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 364/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:50:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:50:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:50:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:50:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036984 Apr 12 09:50:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 366/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:24 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:24 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-1900bb14-cc0a-4271-97be-a2d685d5fbbf tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070785 Apr 12 09:50:24 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 362/1092] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:50:24 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7d16719-f633-43f0-ac1d-a4624f32a587"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289981 Apr 12 09:50:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 365/1093] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:50:27 2023] POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:34 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'services' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:50:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/f7d16719-f633-43f0-ac1d-a4624f32a587" status: 202 len: 0 microversion: 2.1 time: 0.180531 Apr 12 09:50:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 367/1094] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:50:34 2023] DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/f7d16719-f633-43f0-ac1d-a4624f32a587 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:34 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:34 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-202505a8-fbb5-473b-9e03-0b1e1dbc0af3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Apr 12 09:50:34 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 363/1095] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:50:34 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:50:51 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:50:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2798ce35-cd96-4bc7-85c7-01e9bb913897 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1538 microversion: 2.1 time: 0.171950 Apr 12 09:50:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 366/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:50:51 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1538 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a5505522-0afa-4806-87bb-d64a7ca531ec tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058338 Apr 12 09:51:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 368/1097] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:51:25 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "236d7a57-e5bf-4a4d-b5e7-178c2682e457"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:27 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:28 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:28 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464872 Apr 12 09:51:28 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 364/1098] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:51:27 2023] POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:36 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'services' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:51:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/236d7a57-e5bf-4a4d-b5e7-178c2682e457" status: 202 len: 0 microversion: 2.1 time: 0.257641 Apr 12 09:51:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 367/1099] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:51:36 2023] DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/236d7a57-e5bf-4a4d-b5e7-178c2682e457 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2489fd24-d13a-43c1-87b7-4d7fc44b1e78 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049716 Apr 12 09:51:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 369/1100] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:51:36 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:51 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:52 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:51:52 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-38568bcd-a537-4f3e-89ae-9c5363afb75b tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1538 microversion: 2.1 time: 0.173404 Apr 12 09:51:52 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 365/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:51:51 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1538 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Searching by: {'deleted': False, 'project_id': '044d0193867a407ba80522df35f5d667'} {{(pid=61853) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:52 user devstack@n-api.service[61853]: DEBUG nova.compute.multi_cell_list [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61853) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 09:51:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ef845f18-a622-4eb3-a13e-217686e4b120 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.081152 Apr 12 09:51:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 368/1102] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 09:51:52 2023] GET /compute/v2.1/servers => generated 341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:52 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:51:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6a216170-6f1c-4e1c-b5a6-3e891526da1a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1538 microversion: 2.1 time: 0.213598 Apr 12 09:51:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 370/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:51:52 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1538 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b294eb4-8109-4d1d-b1a9-da4ff04df141"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:51:54 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:51:54 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296764 Apr 12 09:51:54 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 366/1104] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:51:54 2023] POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:01 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:52:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a061d0d5-a7b1-4701-9ac3-b10585bc9e03 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1584 microversion: 2.1 time: 0.172313 Apr 12 09:52:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 369/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:52:00 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1584 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:52:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Creating event network-changed:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:52:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034672 Apr 12 09:52:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 371/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:52:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1783529970"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:04 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:04 user devstack@n-api.service[61855]: INFO nova.network.security_group_api [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Adding security group ae513e4d-ae36-42e9-b821-45c9b050169d to port ace77f6f-c8a8-4565-b457-95d085efb6f6 Apr 12 09:52:05 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-84c7fd31-8413-46b7-a9b5-dc06f4f19059 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.692734 Apr 12 09:52:05 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 367/1107] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:52:04 2023] POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Creating event network-changed:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:52:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030029 Apr 12 09:52:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 372/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:52:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:05 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:52:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ab128b56-6a1e-433d-b78a-834881f3928f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1750 microversion: 2.1 time: 0.182708 Apr 12 09:52:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 370/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:52:05 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:05 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:05 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.199351 Apr 12 09:52:05 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 368/1110] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:52:05 2023] POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:05 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:52:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bd7423b9-455d-4e6a-a475-89bcfd5bcf6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1742 microversion: 2.1 time: 0.160571 Apr 12 09:52:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 373/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:52:05 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:52:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-unplugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Creating event network-vif-unplugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:52:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035867 Apr 12 09:52:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 371/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:52:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:11 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}, {"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:11 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:52:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:52:11 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049169 Apr 12 09:52:11 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 369/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:52:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030542 Apr 12 09:52:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 374/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:52:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=22 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-05093c29-0f15-4603-a837-3586e8931f46 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093600 Apr 12 09:52:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 372/1115] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:52:26 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6baf2427-9e28-4917-8705-50963ef3be76"}} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:29 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:29 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294061 Apr 12 09:52:29 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 370/1116] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 09:52:29 2023] POST /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:37 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'services' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:52:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/6baf2427-9e28-4917-8705-50963ef3be76" status: 202 len: 0 microversion: 2.1 time: 0.155636 Apr 12 09:52:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 375/1117] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:52:37 2023] DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments/6baf2427-9e28-4917-8705-50963ef3be76 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-08dc3acf-f49e-45b7-8081-fa86bc617df3 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056632 Apr 12 09:52:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 373/1118] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:52:37 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:52:55 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:52:56 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:52:56 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-c74136e7-9fe8-4bb1-941f-a93a4b7e12ab tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1750 microversion: 2.1 time: 0.178792 Apr 12 09:52:56 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 371/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:52:55 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5e1a0c17-d47e-40fb-aaf0-d2296f99abad tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055007 Apr 12 09:53:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 376/1120] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:53:27 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:53:41 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:41 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "tag": "0db4838f-8419-4187-a457-94bb66310863"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:53:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Creating event network-changed:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:53:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080663 Apr 12 09:53:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 374/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=6 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:45 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:53:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" status: 204 len: 0 microversion: 2.1 time: 0.155633 Apr 12 09:53:45 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 372/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:53:45 2023] DELETE /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "name": "network-vif-unplugged", "status": "completed", "tag": "0db4838f-8419-4187-a457-94bb66310863"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:53:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Creating event network-vif-unplugged:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:53:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033853 Apr 12 09:53:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 375/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:53:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:53:45 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21416f43494540f2ad0c2e36edd3dc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71345b53304d4b99b233f65d427343ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:53:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0ea62e42-865d-483b-9b8a-4312b3c39d13 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" status: 200 len: 1574 microversion: 2.1 time: 0.280017 Apr 12 09:53:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 377/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:53:45 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => generated 1574 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:53:47 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "name": "network-vif-plugged", "status": "completed", "tag": "0db4838f-8419-4187-a457-94bb66310863"}, {"server_uuid": "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1", "name": "network-vif-deleted", "tag": "0db4838f-8419-4187-a457-94bb66310863"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:53:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:47 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Creating event network-vif-plugged:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:53:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Creating event network-vif-deleted:0db4838f-8419-4187-a457-94bb66310863 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 on user Apr 12 09:53:47 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030072 Apr 12 09:53:47 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 373/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1783529970"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:56 user devstack@n-api.service[61853]: INFO nova.network.security_group_api [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Removing security group ae513e4d-ae36-42e9-b821-45c9b050169d from port ace77f6f-c8a8-4565-b457-95d085efb6f6 Apr 12 09:53:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-281440ae-0e42-4955-a6c1-4e9c9e93a288 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.682359 Apr 12 09:53:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 376/1126] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:53:56 2023] POST /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:53:56 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:56 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:53:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Creating event network-changed:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:53:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086282 Apr 12 09:53:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 378/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:53:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:57 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:58 user devstack@n-api.service[61855]: DEBUG nova.objects.instance [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'services' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=61855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:53:58 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments/9b294eb4-8109-4d1d-b1a9-da4ff04df141" status: 202 len: 0 microversion: 2.1 time: 0.201579 Apr 12 09:53:58 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 374/1128] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:53:57 2023] DELETE /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments/9b294eb4-8109-4d1d-b1a9-da4ff04df141 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-84a205be-24c8-4949-9d9d-01f8f8cb96ae tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Apr 12 09:53:58 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 377/1129] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:53:58 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:53:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:53:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:53:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:53:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:53:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Creating event network-changed:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:53:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031278 Apr 12 09:53:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 379/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:53:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] HTTP exception thrown: Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 could not be found. Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Request method failure captured: Apr 12 09:54:35 user devstack@n-api.service[61855]: request: GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 HTTP/1.1 Apr 12 09:54:35 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:54:35 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:54:35 user devstack@n-api.service[61855]: Connection: close Apr 12 09:54:35 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:54:35 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:54:35 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:54:35 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:54:35 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNn4k6oS1aq-_rObKDpwUNItyxHCyUFxpwr8zBnubYB8deLS0LeLQX7OJ45XANvX_nUCGQ2-iyFqPQ2GGEJ9tJs7C0DUTmqBzB0_eR9Ou2ghRI0wkFAI5PYjp1BeMcPgKPG8R7_mzYZCRwIfNXb0vU1xpTEyZB-yjb9gJ2FT_fzgYMBU Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Project-Id: 71345b53304d4b99b233f65d427343ba Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Project-Name: tempest-SnapshotDataIntegrityTests-977295797 Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71345b53304d4b99b233f65d427343ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71345b53304d4b99b233f65d427343ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71345b53304d4b99b233f65d427343ba"}]}] Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Tenant: tempest-SnapshotDataIntegrityTests-977295797 Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Tenant-Id: 71345b53304d4b99b233f65d427343ba Apr 12 09:54:35 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-977295797 Apr 12 09:54:35 user devstack@n-api.service[61855]: X-User: tempest-SnapshotDataIntegrityTests-977295797-project-member Apr 12 09:54:35 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:54:35 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:54:35 user devstack@n-api.service[61855]: X-User-Id: 21416f43494540f2ad0c2e36edd3dc6f Apr 12 09:54:35 user devstack@n-api.service[61855]: X-User-Name: tempest-SnapshotDataIntegrityTests-977295797-project-member Apr 12 09:54:35 user devstack@n-api.service[61855]: method: > Apr 12 09:54:35 user devstack@n-api.service[61855]: exception: Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 could not be found. Apr 12 09:54:35 user devstack@n-api.service[61855]: action_args: {'id': '98f44ec7-7456-4cb7-9f46-bb19adeaa9b1'} Apr 12 09:54:35 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 could not be found. Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 could not be found. Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 could not be found. Apr 12 09:54:35 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:35 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Returning 404 to user: Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 could not be found. {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:54:35 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-1d8fa170-09aa-4ca1-8c87-2433852c4db6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" status: 404 len: 111 microversion: 2.1 time: 0.037183 Apr 12 09:54:35 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 375/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:54:35 2023] GET /compute/v2.1/servers/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:54:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-be8116af-21d6-45b5-93c9-652a18bda8b6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Calling method '.version_select at 0x7fbd5b93c0d0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:54:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-be8116af-21d6-45b5-93c9-652a18bda8b6 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2042005072" status: 202 len: 0 microversion: 2.1 time: 0.029577 Apr 12 09:54:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 378/1132] 10.0.0.210 () {62 vars in 1355 bytes} [Wed Apr 12 09:54:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2042005072 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:54:48 user devstack@n-api.service[61854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3abb28e-a3c2-4590-a9f1-81643dfb0d24] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-09edfa75-9f1c-4997-8f93-67abb0f1efc3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051378 Apr 12 09:54:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 380/1133] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 09:54:48 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.wsgi [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] HTTP exception thrown: Instance 038696c5-53db-4679-b396-2328710f8cdd is not attached to volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141 Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Request method failure captured: Apr 12 09:54:48 user devstack@n-api.service[61855]: request: DELETE /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments/9b294eb4-8109-4d1d-b1a9-da4ff04df141 HTTP/1.1 Apr 12 09:54:48 user devstack@n-api.service[61855]: Accept: application/json Apr 12 09:54:48 user devstack@n-api.service[61855]: Accept-Encoding: identity Apr 12 09:54:48 user devstack@n-api.service[61855]: Connection: close Apr 12 09:54:48 user devstack@n-api.service[61855]: Content-Length: 0 Apr 12 09:54:48 user devstack@n-api.service[61855]: Content-Type: application/json Apr 12 09:54:48 user devstack@n-api.service[61855]: Host: 10.0.0.210 Apr 12 09:54:48 user devstack@n-api.service[61855]: Openstack-System-Scope: None Apr 12 09:54:48 user devstack@n-api.service[61855]: User-Agent: python-urllib3/1.26.15 Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Auth-Token: gAAAAABkNn1jPO4A7Fe8Gq1S6HaPfuby4JhKEG2dEDVmzE-SIpt3dLriocjOHPADLB6NyY7UMw9zP6YMCdk1rxN9pfJ0dgpdOLjFcBfvWslHF6Xbp-jxv9RU-AjBrRykROPaGJeJBXxcJRWM8Tr_xZmX1yaphcGwzDTEGZur17HEDj81_TL3E6s Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Domain-Id: None Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Domain-Name: None Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Identity-Status: Confirmed Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Is-Admin-Project: True Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Project-Domain-Id: default Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Project-Domain-Name: Default Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Project-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Project-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Role: reader,member Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Roles: reader,member Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/044d0193867a407ba80522df35f5d667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}] Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Tenant: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Tenant-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:54:48 user devstack@n-api.service[61855]: X-Tenant-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:54:48 user devstack@n-api.service[61855]: X-User: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:54:48 user devstack@n-api.service[61855]: X-User-Domain-Id: default Apr 12 09:54:48 user devstack@n-api.service[61855]: X-User-Domain-Name: Default Apr 12 09:54:48 user devstack@n-api.service[61855]: X-User-Id: 345fff9dd4ce4b74bc87ff29db51e162 Apr 12 09:54:48 user devstack@n-api.service[61855]: X-User-Name: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:54:48 user devstack@n-api.service[61855]: method: > Apr 12 09:54:48 user devstack@n-api.service[61855]: exception: Instance 038696c5-53db-4679-b396-2328710f8cdd is not attached to volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141 Apr 12 09:54:48 user devstack@n-api.service[61855]: action_args: {'server_id': '038696c5-53db-4679-b396-2328710f8cdd', 'id': '9b294eb4-8109-4d1d-b1a9-da4ff04df141'} Apr 12 09:54:48 user devstack@n-api.service[61855]: {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9b294eb4-8109-4d1d-b1a9-da4ff04df141. Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038696c5-53db-4679-b396-2328710f8cdd is not attached to volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141 Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038696c5-53db-4679-b396-2328710f8cdd is not attached to volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141 Apr 12 09:54:48 user devstack@n-api.service[61855]: ERROR nova.api.openstack.wsgi Apr 12 09:54:48 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Returning 404 to user: Instance 038696c5-53db-4679-b396-2328710f8cdd is not attached to volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141 {{(pid=61855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:54:48 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-eb48ee0a-6137-4b02-b992-e4889fc7fb6a tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments/9b294eb4-8109-4d1d-b1a9-da4ff04df141" status: 404 len: 154 microversion: 2.1 time: 0.109420 Apr 12 09:54:48 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 376/1134] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 09:54:48 2023] DELETE /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd/os-volume_attachments/9b294eb4-8109-4d1d-b1a9-da4ff04df141 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 09:54:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 204 len: 0 microversion: 2.1 time: 0.124290 Apr 12 09:54:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 379/1135] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 09:54:50 2023] DELETE /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:50 user devstack@n-api.service[61854]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3abb28e-a3c2-4590-a9f1-81643dfb0d24] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47792. Apr 12 09:54:50 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:54:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a18b441a-f7e2-4a39-ab2f-65fb7b42c8d9 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 200 len: 1544 microversion: 2.1 time: 0.190185 Apr 12 09:54:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 381/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:54:50 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:54:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-unplugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:54:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Creating event network-vif-unplugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:54:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040021 Apr 12 09:54:51 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 377/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:54:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:54:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}, {"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}, {"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}, {"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}, {"server_uuid": "038696c5-53db-4679-b396-2328710f8cdd", "name": "network-vif-deleted", "tag": "ace77f6f-c8a8-4565-b457-95d085efb6f6"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:54:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:54:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:54:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:54:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:54:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:54:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:54:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Creating event network-vif-plugged:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:54:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Creating event network-vif-deleted:ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance 038696c5-53db-4679-b396-2328710f8cdd on user Apr 12 09:54:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.032872 Apr 12 09:54:53 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 380/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:54:53 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:55:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:55:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:55:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] HTTP exception thrown: Instance 038696c5-53db-4679-b396-2328710f8cdd could not be found. Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Request method failure captured: Apr 12 09:55:41 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd HTTP/1.1 Apr 12 09:55:41 user devstack@n-api.service[61854]: Accept: application/json Apr 12 09:55:41 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 09:55:41 user devstack@n-api.service[61854]: Connection: close Apr 12 09:55:41 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 09:55:41 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 09:55:41 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 09:55:41 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 09:55:41 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNn1jPO4A7Fe8Gq1S6HaPfuby4JhKEG2dEDVmzE-SIpt3dLriocjOHPADLB6NyY7UMw9zP6YMCdk1rxN9pfJ0dgpdOLjFcBfvWslHF6Xbp-jxv9RU-AjBrRykROPaGJeJBXxcJRWM8Tr_xZmX1yaphcGwzDTEGZur17HEDj81_TL3E6s Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Project-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/044d0193867a407ba80522df35f5d667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/044d0193867a407ba80522df35f5d667"}]}] Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Tenant: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Tenant-Id: 044d0193867a407ba80522df35f5d667 Apr 12 09:55:41 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestMinimumBasicScenario-935210424 Apr 12 09:55:41 user devstack@n-api.service[61854]: X-User: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:55:41 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 09:55:41 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 09:55:41 user devstack@n-api.service[61854]: X-User-Id: 345fff9dd4ce4b74bc87ff29db51e162 Apr 12 09:55:41 user devstack@n-api.service[61854]: X-User-Name: tempest-TestMinimumBasicScenario-935210424-project-member Apr 12 09:55:41 user devstack@n-api.service[61854]: method: > Apr 12 09:55:41 user devstack@n-api.service[61854]: exception: Instance 038696c5-53db-4679-b396-2328710f8cdd could not be found. Apr 12 09:55:41 user devstack@n-api.service[61854]: action_args: {'id': '038696c5-53db-4679-b396-2328710f8cdd'} Apr 12 09:55:41 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038696c5-53db-4679-b396-2328710f8cdd could not be found. Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038696c5-53db-4679-b396-2328710f8cdd could not be found. Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038696c5-53db-4679-b396-2328710f8cdd could not be found. Apr 12 09:55:41 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 09:55:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Returning 404 to user: Instance 038696c5-53db-4679-b396-2328710f8cdd could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 09:55:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d26993a1-158f-406f-9d37-062c700375f8 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd" status: 404 len: 111 microversion: 2.1 time: 0.275717 Apr 12 09:55:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 382/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:55:40 2023] GET /compute/v2.1/servers/038696c5-53db-4679-b396-2328710f8cdd => generated 111 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 09:55:41 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:55:41 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=8 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:55:41 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-35a399cc-dfdd-4307-a198-4fe985a6fef3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Calling method '.version_select at 0x7fbd5d11add0>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:55:41 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-35a399cc-dfdd-4307-a198-4fe985a6fef3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594156326" status: 202 len: 0 microversion: 2.1 time: 0.037360 Apr 12 09:55:41 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 378/1140] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 09:55:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594156326 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:56:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7a5ced2f-8098-420b-99f8-f33d9a789b3f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Action: 'create', calling method: .version_select at 0x7fbd5bc48c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1327781575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbIHkLy/ZaS7I86g28/cyDoPMLIqYkiwil20yy/1/mYGQkBUzkCtomC9/9O4wF4HiETVDL+gU3iWDQtjM5Qn6bh1z4IeBZ0KCKrX8IjnLqkuH596ao7cpyWwb66W7mkOQ=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:56:01 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-7a5ced2f-8098-420b-99f8-f33d9a789b3f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting quotas for project d7c0fc3ce4eb416da7fe6d87e6bf098e. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:56:01 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-7a5ced2f-8098-420b-99f8-f33d9a789b3f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting quotas for user cae630b769ab40a3bc9b9664ff51feeb and project d7c0fc3ce4eb416da7fe6d87e6bf098e. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:56:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7a5ced2f-8098-420b-99f8-f33d9a789b3f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278409 Apr 12 09:56:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 381/1141] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 09:56:01 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:56:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1200568600", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1327781575", "security_groups": [{"name": "tempest-secgroup-smoke-389023254"}], "networks": [{"uuid": "6e59753f-559d-41f9-b8dd-1429c37fd51b"}], "block_device_mapping_v2": [{"uuid": "08d398ab-f835-4964-9e8c-06f093ac746e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:56:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:05 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] validate_networks() for [('6e59753f-559d-41f9-b8dd-1429c37fd51b', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting quotas for project d7c0fc3ce4eb416da7fe6d87e6bf098e. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting quotas for user cae630b769ab40a3bc9b9664ff51feeb and project d7c0fc3ce4eb416da7fe6d87e6bf098e. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 09:56:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08d398ab-f835-4964-9e8c-06f093ac746e',volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 09:56:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.885505 Apr 12 09:56:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 383/1142] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 09:56:05 2023] POST /compute/v2.1/servers => generated 403 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 09:56:06 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:06 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-beb817dc-fb90-407a-a9a2-8ec2516af9fd tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:56:06 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-beb817dc-fb90-407a-a9a2-8ec2516af9fd tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:56:06 user devstack@n-api.service[61855]: DEBUG nova.policy [None req-beb817dc-fb90-407a-a9a2-8ec2516af9fd tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61855) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:56:06 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-beb817dc-fb90-407a-a9a2-8ec2516af9fd tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1084 microversion: 2.1 time: 0.075048 Apr 12 09:56:06 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 379/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:56:06 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1084 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:56:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:56:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:56:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:56:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:56:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Creating event network-changed:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:56:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034504 Apr 12 09:56:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 382/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:56:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-plugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:56:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:56:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:56:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:56:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Creating event network-vif-plugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:56:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053476 Apr 12 09:56:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 384/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:56:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:56:17 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-plugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:56:17 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:17 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell0:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:56:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:56:17 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:56:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Creating event network-vif-plugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:56:17 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046570 Apr 12 09:56:17 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 380/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:56:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:56:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:56:57 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:56:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4c061886-a64f-4dd0-9cbe-cc6f1c699392 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1433 microversion: 2.1 time: 0.287764 Apr 12 09:56:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 383/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:56:56 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1433 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:57:57 user devstack@n-api.service[61854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 09:57:57 user devstack@n-api.service[61854]: Wed Apr 12 09:57:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 (ip 10.0.0.210) !!! Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:57:57 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:57:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-eded68c2-faa2-48d5-8f90-a56dfe93a21f tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1433 microversion: 2.1 time: 0.237132 Apr 12 09:57:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 385/1148] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:57:57 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1433 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:57:59 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:57:59 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=2 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:57:59 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:57:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:57:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:57:59 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:57:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Creating event network-changed:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:57:59 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044678 Apr 12 09:57:59 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 381/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:57:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:00 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'flavor' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 09:58:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118/action" status: 202 len: 0 microversion: 2.1 time: 0.111176 Apr 12 09:58:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 384/1150] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:58:00 2023] POST /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:00 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:58:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-34429d33-8eb9-4969-8ade-942232df34b3 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1558 microversion: 2.1 time: 0.184086 Apr 12 09:58:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 386/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:58:00 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:58:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-unplugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:58:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Creating event network-vif-unplugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:58:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075178 Apr 12 09:58:00 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 382/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:58:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:58:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-plugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}, {"name": "network-changed", "server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:58:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Creating event network-vif-plugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:58:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Creating event network-changed:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:58:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.031080 Apr 12 09:58:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 385/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:58:50 user devstack@n-api.service[61854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3abb28e-a3c2-4590-a9f1-81643dfb0d24] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 09:58:50 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:58:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8aec087d-54e1-4939-ae31-833a3505c961 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1499 microversion: 2.1 time: 0.202751 Apr 12 09:58:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 387/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:58:50 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1499 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=4 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:59:50 user devstack@n-api.service[61855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 09:59:50 user devstack@n-api.service[61855]: Wed Apr 12 09:59:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118/action (ip 10.0.0.210) !!! Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:59:50 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:59:51 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61855) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 09:59:51 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118/action" status: 202 len: 0 microversion: 2.1 time: 0.207881 Apr 12 09:59:51 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 383/1155] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 09:59:50 2023] POST /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:59:51 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 09:59:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0584fba0-acab-401a-8caa-a9ff9098b23a tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1507 microversion: 2.1 time: 0.186913 Apr 12 09:59:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 386/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 09:59:51 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 09:59:57 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:59:57 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 09:59:57 user devstack@n-api.service[61854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 09:59:57 user devstack@n-api.service[61854]: Wed Apr 12 09:59:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 09:59:57 user devstack@n-api.service[61854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 09:59:57 user devstack@n-api.service[61854]: Wed Apr 12 09:59:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 09:59:57 user devstack@n-api.service[61854]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3abb28e-a3c2-4590-a9f1-81643dfb0d24] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57242. Apr 12 09:59:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 09:59:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 09:59:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 09:59:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 09:59:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Creating event network-changed:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 09:59:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103038 Apr 12 09:59:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 388/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 09:59:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:00:00 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-plugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:00:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:00:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:00:00 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:00:00 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Creating event network-vif-plugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 10:00:01 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045197 Apr 12 10:00:01 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 384/1158] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:00:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:00:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:00:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:00:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-plugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:00:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:00:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:00:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:00:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Creating event network-vif-plugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 10:00:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033855 Apr 12 10:00:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 387/1159] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:00:41 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:00:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-dd6fbdc9-054e-4989-9656-aaa28fe5c1c4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1552 microversion: 2.1 time: 0.208119 Apr 12 10:00:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 389/1160] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:00:41 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1552 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:01:42 user devstack@n-api.service[61855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 10:01:42 user devstack@n-api.service[61855]: Wed Apr 12 10:01:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 (ip 10.0.0.210) !!! Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG dbcounter [-] [61855] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61855) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:01:42 user devstack@n-api.service[61853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f04455da-8eb3-400e-bef9-35f8dcf8bf88] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 10:01:42 user devstack@n-api.service[61853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 10:01:42 user devstack@n-api.service[61853]: Wed Apr 12 10:01:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 10:01:42 user devstack@n-api.service[61853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 10:01:42 user devstack@n-api.service[61853]: Wed Apr 12 10:01:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 10:01:42 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:01:42 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61855) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:01:42 user devstack@n-api.service[61855]: DEBUG nova.compute.api [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Going to try to terminate instance {{(pid=61855) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:01:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:01:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:01:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:01:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:01:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Creating event network-changed:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 10:01:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130891 Apr 12 10:01:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 388/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:01:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:01:42 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 204 len: 0 microversion: 2.1 time: 0.141037 Apr 12 10:01:42 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 385/1162] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:01:42 2023] DELETE /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:01:42 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:01:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9d7c5503-8230-4f08-9b95-c538674c8f1b tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 200 len: 1558 microversion: 2.1 time: 0.232809 Apr 12 10:01:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 390/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:01:42 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:01:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-unplugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:01:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:01:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:01:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:01:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Creating event network-vif-unplugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 10:01:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029931 Apr 12 10:01:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 389/1164] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:01:45 user devstack@n-api.service[61855]: DEBUG nova.api.openstack.wsgi [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-plugged", "status": "completed", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}, {"server_uuid": "092fe940-0f21-43d4-a65d-ea9f1c246118", "name": "network-vif-deleted", "tag": "9805333e-4e37-49d1-913c-8c40e5c03c56"}]} {{(pid=61855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:01:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:01:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:01:45 user devstack@n-api.service[61855]: DEBUG oslo_concurrency.lockutils [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61855) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:01:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Creating event network-vif-plugged:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 10:01:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.compute.server_external_events [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Creating event network-vif-deleted:9805333e-4e37-49d1-913c-8c40e5c03c56 for instance 092fe940-0f21-43d4-a65d-ea9f1c246118 on user Apr 12 10:01:45 user devstack@n-api.service[61855]: INFO nova.api.openstack.requestlog [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029303 Apr 12 10:01:45 user devstack@n-api.service[61855]: [pid: 61855|app: 0|req: 386/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:01:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:02:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "af22f43d-4450-44e6-b1ae-31d2ee8b98d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:02:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] HTTP exception thrown: Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 could not be found. Apr 12 10:02:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Request method failure captured: Apr 12 10:02:33 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 HTTP/1.1 Apr 12 10:02:33 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:02:33 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:02:33 user devstack@n-api.service[61854]: Connection: close Apr 12 10:02:33 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:02:33 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:02:33 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:02:33 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:02:33 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNoAqzluMFKxog0wqkFe0FVERL3ispeG1eWBkjVoy9htM6U_SmPJllpO5gWbnkOTumz3lo40WgHSvPxGLDo82Se85PgA3-5OAYs4uv2TfsV3Z1WsKSbo2IyKLfNU2mFXPCstUe0nXK-WLlvmF2CAsFi12sVxzhPi4r4qdRdJeARz6BSw Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Project-Id: d7c0fc3ce4eb416da7fe6d87e6bf098e Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestShelveInstance-2080640322 Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Role: reader,member Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Roles: reader,member Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d7c0fc3ce4eb416da7fe6d87e6bf098e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d7c0fc3ce4eb416da7fe6d87e6bf098e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d7c0fc3ce4eb416da7fe6d87e6bf098e"}]}] Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Tenant: tempest-TestShelveInstance-2080640322 Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Tenant-Id: d7c0fc3ce4eb416da7fe6d87e6bf098e Apr 12 10:02:33 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestShelveInstance-2080640322 Apr 12 10:02:33 user devstack@n-api.service[61854]: X-User: tempest-TestShelveInstance-2080640322-project-member Apr 12 10:02:33 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:02:33 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:02:33 user devstack@n-api.service[61854]: X-User-Id: cae630b769ab40a3bc9b9664ff51feeb Apr 12 10:02:33 user devstack@n-api.service[61854]: X-User-Name: tempest-TestShelveInstance-2080640322-project-member Apr 12 10:02:33 user devstack@n-api.service[61854]: method: > Apr 12 10:02:33 user devstack@n-api.service[61854]: exception: Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 could not be found. Apr 12 10:02:33 user devstack@n-api.service[61854]: action_args: {'id': '092fe940-0f21-43d4-a65d-ea9f1c246118'} Apr 12 10:02:33 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 could not be found. Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 could not be found. Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 could not be found. Apr 12 10:02:33 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:02:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Returning 404 to user: Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:02:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-852573f9-f7de-49bf-b8db-027416ad34fc tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118" status: 404 len: 111 microversion: 2.1 time: 0.042894 Apr 12 10:02:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 391/1166] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:02:32 2023] GET /compute/v2.1/servers/092fe940-0f21-43d4-a65d-ea9f1c246118 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:02:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-df0d4fd8-909c-433b-b974-3af9e27f83b4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Calling method '.version_select at 0x7fbd5ba03eb0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:02:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:02:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:02:33 user devstack@n-api.service[61853]: INFO oslo.messaging._drivers.impl_rabbit [-] [f04455da-8eb3-400e-bef9-35f8dcf8bf88] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57306. Apr 12 10:02:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-df0d4fd8-909c-433b-b974-3af9e27f83b4 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1327781575" status: 202 len: 0 microversion: 2.1 time: 0.036159 Apr 12 10:02:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 390/1167] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 10:02:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1327781575 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)